Data EngineerPerfict Global, Inc. • San Francisco, CA, United States
[error_messages.no_longer_accepting]
Data Engineer
Perfict Global, Inc. • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
Job Title : Data Engineer
Location: San Francisco CA
Hybrid - Monday/Friday Remote + Onsite
595 Market St. #200, San Francisco, CA on Tuesday/Wed/Thursday
Duration: Long Term Contact
Roles & Responsibilities
Location: San Francisco CA
Hybrid - Monday/Friday Remote + Onsite
595 Market St. #200, San Francisco, CA on Tuesday/Wed/Thursday
Duration: Long Term Contact
Roles & Responsibilities
- You will build systems, core libraries and frameworks that power our batch and streaming Data and ML applications. The services you build will integrate directly with LendingClub's products, opening the door to new features.
- You will work with modern data technologies such as Hadoop, Spark, DBT,
- Dagster/Airflow, Atlan, Trino, etc., modern data platforms such as
- Databricks and Snowflake and cloud technologies across AWS stack
- Build data pipelines that transform raw data into canonical schema representing business entities and publish it into the Data Lake
- Implement internal process improvements: automating manual processes, optimizing data delivery, reducing cloud costs, redesigning infrastructure for greater scalability, etc.
- Work with stakeholders including the Business, Product, Program and Engineering teams to deliver required data in time with high quality at reasonable cost
- Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage.
- Support operations to manage the production environment and help in resolving production issues with RCA
- Write unit/integration tests, adopt Test-driven development, contribute to engineering wiki, and document design/implementation etc.
- 4+ years of experience and a bachelor's degree in computer science or a related field; or equivalent work experience
- Working experience of distributed systems Hadoop, Spark, Hive, Kafka, DBT and Airflow/Dagster
- At least 2 year of production coding experience in data pipeline implementation in Python
- Experience working with public cloud platforms, preferably AWS
- Experience working with Databricks and/or Snowflake
- Experience in Git, JIRA, Jenkins, shell scripting
- Familiarity with Agile methodology, test-driven development, source control management and test automation
- Experience supporting and working with cross-functional teams in a dynamic environment
- You have excellent collaborative problem solving and communication skills and are empathetic to others
- You believe in simple and elegant solutions and give paramount importance to quality
- You have a track record of building fast, reliable, and high-quality data pipelines
[job_alerts.create_a_job]
Data Engineer • San Francisco, CA, United States
[internal_linking.similar_jobs]
Location: San Francisco, CA Hybrid Monday/Friday Remote + Onsite 595 Market St.San Francisco, CA on Tuesday/Wed/Thursday Duration: Long Term.Roles & Responsibilities: You will build systems, core l...[show_more]
Location: San Mateo, California.Job Overview: Revvo's purpose is to monitor and maximize the life of tires.Our Data Engineers create scalable solutions enabling real-time analytics on our datasets....[show_more]
Promise modernizes how government agencies and utilities support people in financial difficulty.We build technology that makes it simple for residents to receive benefits, engage with assistance pr...[show_more]
Brex is the AI-powered spend platform.We help companies spend with confidence with integrated corporate cards, banking, and global payments, plus intuitive software for travel and expenses.Tens of ...[show_more]
We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base.You'll play a foundational role in shaping ho...[show_more]
Factory is bringing autonomy to software engineering, and we're hiring a Data Engineer to own the systems that power how we understand and operate the business.You'll architect and evolve the full ...[show_more]
CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our federal customers...[show_more]
We are seeking a mission-driven Data Engineer to act as the technical partner across the full customer lifecycle, from pre-sales through post-sales adoption.This role works closely with Machine Lea...[show_more]
Discord is used by over 200 million people every month for many different reasons, but there's one thing that nearly everyone does on our platform: play video games.Over 90% of our users play games...[show_more]
RadiumOne is a global programmatic ad buying platform.RadiumOne is the 6th largest web property in the U.We build intelligent software that automates media buying, making big data actionable for ma...[show_more]
We are an applied AI lab building end-to-end software agents.Were the makers of Devin, the first AI software engineer.Cognition is building collaborative AI teammates that enable engineers to focus...[show_more]
Data Engineer – Stefanini Group.Stefanini Group is hiring a Data Engineer for various locations across USA (Hybrid).Contact Prakhar Goel: 248‑263‑5255 / Prakhar.As a Data Engineer, this CW will be ...[show_more]
Data Engineer Role At Air Apps.At Air Apps, we believe in thinking biggerand moving faster.We're a family-founded company on a mission to create the world's first AI-powered Personal & Entrepreneur...[show_more]
GridCARE solves data center developers' most urgent bottleneck immediate access to power through a pioneering physics-based generative AI platform that unlocks gigawatts of near-term capacity from ...[show_more]
Changing the world through digital experiences is what Adobe’s all about.We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital exper...[show_more]
The Applied team works across research, engineering, product, and design to bring OpenAI's technology to consumers and businesses.We seek to learn from deployment and distribute the benefits of AI,...[show_more]
CodeRabbit is an innovative research and development company focused on building extraordinarily productive human-machine collaboration systems.Our primary goal is to create the next generation of ...[show_more]
This is a hybrid position from day one.They are building out a scoring engine for their merchants.Very similar to rewards for issuers.Downtown San Francisco - Three days in office.[show_more]
Data Engineer
Perfict Global, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
Revvo • San Mateo, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
Promise • Oakland, CA, United States
[job_card.permanent]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
Brex • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
Wonders Child Care Center • San Mateo, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Factory • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Contact Government Services LLC • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Data Engineer
Medeloop • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer, Analytics
Discord • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Stepping Up Solutions • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Cognition AI • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Stefanini Group • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Air Apps • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
GridCARE • Redwood City, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
Adobe • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer, Analytics
OpenAI • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
CodeRabbit • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Data Engineer
ShiftCode Analytics • San Francisco, CA, United States
[job_card.temporary]
[last_updated.last_updated_1_day] • [promoted]