Talent.com
Mindlance
Data Engineer IIMindlance • Sunnyvale, CA
Data Engineer II

Data Engineer II

Mindlance • Sunnyvale, CA
18 hours ago
Job type
  • Full-time
Job description

Job Title: Contract Data Engineer (API & Database Focus)

Role Summary:

We are seeking an experienced and highly skilled Contract Data Engineer. This role is focused on building robust data pipelines, primarily involving the integration of data from various APIs and managing critical data infrastructure. The successful candidate will work hands-on with Databricks, Snowflake, and/or relational databases, ensuring data is clean, reliable, and optimized for consumption by analytics tools like Tableau. This is a project-based contract position requiring someone who can quickly integrate and deliver results.

Key Responsibilities:

  • Design, develop, and maintain scalable data ingestion pipelines to extract data from various third-party and internal APIs (REST, SOAP, etc.).
  • Implement efficient data transformation and loading processes (ETL/ELT) within the data platform.
  • Manage and optimize data storage and schemas in Snowflake and Postgres databases.
  • Utilize Databricks for data processing, transformation, and orchestration tasks.
  • Ensure data quality, accuracy, and integrity throughout the data pipelines.
  • Collaborate with data analysts and BI developers (particularly Tableau users) to understand data requirements and optimize data models for performance.
  • Monitor data pipelines and systems for performance issues, errors, and data discrepancies, implementing necessary fixes and improvements.
  • Develop and maintain technical documentation for data pipelines, processes, and data models.
  • Troubleshoot data-related issues and provide timely resolutions.
  • Implement best practices for data security and governance within the data platform.

Required Skills and Qualifications:

  • Proven experience as a Data Engineer, with a strong focus on API integration and database management.
  • Experience building data pipelines for API data ingestion, including handling authentication, error handling, and data parsing.
  • Strong proficiency in SQL and experience with database design, query optimization, and performance tuning in relational databases (, Postgres).
  • Hands-on experience with Snowflake as a cloud data warehouse, including data loading, querying, and performance optimization.
  • Experience using Databricks for data processing, ETL/ELT, and pipeline orchestration (, PySpark, notebooks).
  • Proficiency in a programming language commonly used for data engineering (, Python).
  • Experience working with cloud platforms (, AWS, Azure, GCP) where Snowflake and Databricks are deployed.
  • Understanding of data warehousing concepts and best practices.
  • Experience supporting BI tools (like Tableau) by providing clean, structured, and performant data sources.
  • Excellent problem-solving skills and ability to work independently in a fast-paced environment.
  • Strong communication and collaboration skills.

Desired Skills (Nice to Have):

  • Experience with specific ETL/orchestration tools (, Airflow, Fivetran, dbt).
  • Familiarity with containerization technologies (, Docker).
  • Experience in a contract or consulting role.
  • Knowledge of data governance and compliance standards.
  • Experience with BI tools like Tableau, including dashboard creation or assisting BI developers with visualization best practices related to data structure.
Create a job alert for this search

Data Engineer II • Sunnyvale, CA

Similar jobs

Data Engineer II

Pinnacle Technical ResourcesSunnyvale, CA, US
$55.00 hourly
Full-time

Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail-oriented Data Engineer II to join our team.The ideal c... Show more

 • Promoted

Data Engineer - Remote

EXPERISSunnyvale, CA, United States
Remote
Full-time

Data EngineerWe're hiring a Data Engineer to design, build, and operate the data pipelines and platform that power analytics and AI / ML use cases.You'll own batch and streaming ingestion, transfor... Show more

 • Promoted

Data Engineer

SynergisticITFremont, CA, United States
Full-time

Launch Your Data Career with Proof, Not PromisesAt SynergisticitIf you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop gues... Show more

 • Promoted

Data Engineer

InterSourcesFremont, CA, United States
Full-time

Certified Databricks ConsultantLocation:TX/GA/CADuration:Long-termClient:IBM/AT&TSkills:Need certified Databricks consultant with good experience in Spark and PySpark.Experience with Azure, Pyt... Show more

 • Promoted

Retail Data Specialist

SAS Retail ServicesCastro Valley, CA, United States
Full-time

We invite you to be a part of transforming shopping experiences and fulfilling our mission to connect people with products that enhance their lives.By joining SAS Retail Services, a part of Advanta... Show more

 • Promoted

Lead Data Engineer

QcellsSanta Clara, CA, US
Full-time

This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational s... Show more

Recovery Specialist II - Mental Health 195

Telecare CorporationSanta Cruz, CA, United States
Full-time +1

DescriptionThey made it easier for me to live, breathe, eat, and stay clean.Without them, I'd be waiting somewhere, waiting for someone to give me a chance to live - Client from TelecareWhat You Wi... Show more

 • Promoted

Remote Senior Data Engineer - AI-Powered Pipelines

Altimate.aiSunnyvale, CA, United States
Remote
Full-time

A leading AI-driven data solutions company in California is seeking a Senior Software Engineer to enhance AI capabilities and build scalable data infrastructures.You will design robust data systems... Show more

 • Promoted

Manufacturing Machine Operator II (2nd Shift)

Threshold EnterprisesScotts Valley, CA, United States
Full-time

Summary of Job Duties:Responsible for operating various equipment in the production process including encapsulation, tablet compression, machine tooling, complicated mixing operations and tablet co... Show more

 • Promoted

Data Engineer

ShiftCode AnalyticsSan Ramon, CA, United States
Full-time

Data EngineerLocation:San Ramon, CA (100% Onsite)Duration:6-12 MonthsPositions:2Start Date:1/9/23Job Description:Integrate, extract the data using ETL and inject using AWS, build pipeline from AWS ... Show more

 • Promoted

Staff Software Engineer, Data Frameworks

Ridge Line ServicesSan Ramon, CA, United States
Full-time

Staff Software Engineer, Data FrameworksAre you a seasoned engineer passionate about transforming data into a powerful business asset? Do you thrive in environments where you can lead by example, m... Show more

 • Promoted

Application Engineer II

EMCOR GroupSan Leandro, CA, United States
Full-time

Application Engineer IiThe application engineer ii will be responsible to coordinate the planning and design of control systems to include programming and system configuration. Show more

 • Promoted

Data Engineer

Staffing the UniverseSanta Clara, CA, United States
Full-time

Data EngineerLocation:RemoteExperience:4YearsAbout the Role:A Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex ... Show more

 • Promoted

Remote Data Engineer

Global Channel ManagementSanta Clara, CA, United States
Remote
Full-time

About the job Remote Data EngineerRemote Data Engineer needs 10 years experienceRemote Data Engineer requires :Must be local top Santa ClaraCloud Platform Expertise (GCP Focus) :Extensive hands-on ... Show more

 • Promoted

County Meter Reader

Meter ReaderSanta Cruz, CA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA, United States
Full-time

Senior Software Engineer - Data InfrastructureApplied Intuition, Inc.Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring... Show more

 • Promoted

Principal Machine Learning Engineer

WorkdayPleasanton, CA, United States
Full-time

Your Work Days Are Brighter HereWe're obsessed with making hard work pay off, for our people, our customers, and the world around us.As a Fortune 500 company and a leading AI platform for managing ... Show more

 • Promoted

Data Engineer (Python, Data Engg, Kafka) | Hybrid

Kaav Inc.Sunnyvale, CA, United States
Full-time

Marketing Technology Team PositionThe Marketing Technology team has the mandate of increasing the rate of customer acquisition, retention, and revenue by optimizing products and inventing new marke... Show more

 • Promoted

Staff Software Engineer, Data (Bay Area / Paris / Remote)

GenesisAISunnyvale, CA, United States
Remote
Full-time

What You'll DoDesign, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scaleOwn core data infrastructure :data ... Show more

 • Promoted

Controller

Viridian StaffingSanta Cruz, CA, United States
Full-time

Viridian Staffing's client is seeking a controller to serve as their first dedicated accounting leader within a fast-growing, innovation-driven organization.This is a unique opportunity for an expe... Show more