Data EngineerForhyre • San Francisco, CA, US
[error_messages.no_longer_accepting]
Data Engineer
Forhyre • San Francisco, CA, US
[job_card.30_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Document component design for developers and for broader communication. Understand and adopt an Agile (SCRUM like) software development mindset Follow established processes / standards, business technology architecture for development, release management and deployment process Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews. Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements. Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies. Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements. Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems. Proven working experience as a data engineer Bachelor degree or equivalent in Computer Science Skilled in Python object-oriented programming Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms Skilled in SQL Skilled in Jenkins Skilled in JSON Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica Skilled in cloud technologies and cloud computing Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere Determining causes of operating errors and taking corrective action Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB Programming including coding, debugging, and using relevant programming languages Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc. Ability to frame ideas as systems and analyzing the inputs, outputs, and process Experience helping an organization to plan and manage change in effort to meet strategic objectives Adept at managing project plans, resources, and people to ensure successful project completion Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
Job Description
Job Description
We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.
Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.
Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL
Secondary : Databricks
Nice to have : Informatica / ETL.
Responsibilities
- Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
- Understand the full end to end development activities from design to go live for ETL development and Azure platform
Recommend and execute improvements
Requirements
[job_alerts.create_a_job]
Data Engineer • San Francisco, CA, US
[internal_linking.similar_jobs]
A technology company is seeking an experienced professional to join its Data Platform team in San Francisco.The role involves designing and building the data platform that supports AI, analytics, a...[show_more]
About Quizlet : At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.
Our $1B+ learning platform serves tens of millions of students every ...[show_more]
The Applied team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses.
We seek to learn from deployment and distribute the benefits of AI,...[show_more]
Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
We're building the kind of platform we always wanted to use : fast, flexible, and built for making sense of real-world complexity.
Behind the scenes is a robust, event-driven architecture that connec...[show_more]
Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...[show_more]
Gemini is a global crypto and Web3 platform founded by Cameron and Tyler Winklevoss in 2014, offering a wide range of simple, reliable, and secure crypto products and services to individuals and in...[show_more]
We're thrilled to embark on the search for a seasoned.Senior / Lead Data Solution Engineer.This pivotal role offers an exciting opportunity to shape the future of technology within our organization.A...[show_more]
With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE)...[show_more]
Senior Data Engineer page is loaded## Senior Data Engineerlocations : San Francisco, CA, USA : AMER - United States - Washington - Offsite / Home : AMER - United States - California - Offsite / Home...[show_more]
We're building the kind of platform we always wanted to use : fast, flexible, and built for making sense of real-world complexity.
Behind the scenes is a robust, event-driven architecture that connec...[show_more]
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...[show_more]
In this exciting role, you will serve as a Data Performance Engineer in NERSC's Application Performance Group, architecting HPC and AI data services that advance fundamental science.You'll optimize...[show_more]
We’re hiring a Staff Data Engineer with a solid software engineering background.You’re strong in Python and comfortable with SQL in a DevOps environment.
You’ll design, build, and improve automated ...[show_more]
PayJoy is a mission-first credit provider dedicated to helping under‑served customers in emerging markets to achieve financial stability and success.
Our patented technology for secured credit provi...[show_more]
As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...[show_more]
JLL empowers you to shape a brighter way.Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world‑class services, advisory and technology f...[show_more]
At Scribd (pronounced “scribbed”), our mission is to spark human curiosity.Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empowe...[show_more]
Enterprise Data Platform Engineer - Lakehouse & Pipelines
Notion • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Staff AI & Data Platform Engineer
Quizlet • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer, Analytics
OpenAI • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer, Data Lake & Governance
Gridware • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Systems & Data Engineer
HyperFi, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Solutions Engineer, Data Infra
Foxglove Technologies Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Principal, Data Engineer
Gemini Trust Company • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior / Lead Data Solution Engineer
Meltwater • Redwood City, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Imaging Data Engineer / Architect
Intuitive.ai • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Principal Data Engineer
Autodesk, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Systems & Data Engineer
HyperFi • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Staff Data Engineer
Visa • Foster City, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
HPC / AI Data Performance Engineer
Lawrence Berkeley National Laboratory • Berkeley, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Staff Data Engineer
prosper.com • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Staff Data Engineer
PayJoy, Inc • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Principal Data Engineer
Tendo • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer 2
JLL • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Staff Data Engineer
Scribd • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]