Talent.com
Data Engineer ID50062
Data Engineer ID50062AgileEngine • Miami, FL, us
Data Engineer ID50062

Data Engineer ID50062

AgileEngine • Miami, FL, us
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

This Senior Data Engineer (Python) role is central to transforming large, diverse datasets into reliable insights that support research and strategic decisions across a global financial platform. You will help shape a unified data ecosystem, partnering with data scientists, researchers, and stakeholders to connect technology with real business impact. What makes this opportunity unique is the scale of data, use of modern cloud, AI, and data engineering practices, and strong influence on platform evolution. It’s a chance to grow technically while contributing to a mission-driven, collaborative environment.

WHAT YOU WILL DO

  • Design and build scalable Data Lakes, Data Warehouses, and Data Lakehouses;
  • Design and implement robust ETL / ELT processes at scale using Python and pipeline orchestration tools like Airflow;
  • Develop ingestion workflows from diverse third-party APIs and data sources;
  • Manage and optimize file formats such as Parquet, Avro, and ORC for high-performance data retrieval;
  • Work with AI development tools to support machine learning initiatives and advanced analytics;
  • Act as a technical consultant to gather requirements, understand business goals, and translate them into technical roadmaps;
  • Work with Terraform and other tools to build AWS and on-prem infrastructure.

MUST HAVES

  • You must be authorized to work for ANY employer in the US, as employment visa sponsorship is not available;
  • Bachelor’s degree in computer science / engineering or other technical field, or equivalent experience;
  • 5+ years of experience with Python with strong hands-on expertise;
  • 5+ years of experience with data processing and analytics libraries such as Pandas, Polars, PySpark, and DuckDB;
  • 2+ years of experience with Big Data technologies such as Spark and Snowflake;
  • Expert-level knowledge of Airflow or similar pipeline orchestration tools;
  • Deep understanding of Medallion Architecture , columnar file formats, and database technologies including SQL, NoSQL, and Lakehouse architectures;
  • Proven ability to work with third-party APIs for complex data ingestion;
  • Proficiency with cloud platforms such as AWS, GCP, and Snowflake, including advanced SQL optimization;
  • Upper-intermediate English level.
  • NICE TO HAVES

  • Familiarity with the fintech industry and financial data domains;
  • Documentation skills for data pipelines, architecture designs, and best practices;
  • OpenSearch or Elasticsearch;
  • AWS SageMaker Studio and Jupyter for data analysis;
  • Terraform;
  • Scala.
  • PERKS AND BENEFITS

  • Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
  • Exciting projects : Modern solutions with Fortune 500 and top product companies.
  • Flextime : Flexible schedule with remote and office options.
  • [job_alerts.create_a_job]

    Data Engineer ID50062 • Miami, FL, us

    [internal_linking.similar_jobs]
    Data Engineer II

    Data Engineer II

    VirtualVocations • Olympia Heights, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer II to maintain a scalable healthcare data platform and deliver impactful data solutions. Key Responsibilities Maintain a scalable healthcare data platform ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Cloud Data Engineer to modernize analytics and engineer data pipelines and models.Key Responsibilities Complete analysis, design, and development of BI solutions Colla...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Engineer

    Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer to join their data team.Key Responsibilities Design, develop, and maintain scalable ETL / ELT pipelines using Azure Databricks and Apache Spark Build and m...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Advanced Cloud Data Engineer

    Advanced Cloud Data Engineer

    VirtualVocations • Olympia Heights, Florida, United States
    [job_card.full_time]
    A company is looking for an Advanced Cloud Data Engineer for a contract position that is 100% remote.Key Responsibilities Complete analysis, design, and development of BI solutions Database deve...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Healthcare Data Engineer

    Healthcare Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Healthcare Data Engineer.Key Responsibilities Support the development and maintenance of secure, scalable data systems for analytics in a HIPAA regulated environment C...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Product Engineer

    Data Product Engineer

    Flow • Miami, FL, US
    [job_card.full_time]
    At Flow, we’re reimagining what it means to live, work, and connect.More than just a real estate company, Flow is a brand, a technology platform, and an operations ecosystem spanning condomin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer III

    Data Engineer III

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems for data products and solutions. Key Responsibilities Design, develop, and maintain data pi...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Advanced Data Engineer

    Advanced Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer - Advanced.Key Responsibilities Perform analysis, design, and development of business intelligence (BI) solutions Develop database solutions using SSIS, ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Engineer with Databricks Focus

    Data Engineer with Databricks Focus

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer with a focus on Databricks.Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks technologies Lead the migration and ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Engineer (Databricks)

    Data Engineer (Databricks)

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Consultant (Databricks).Key Responsibilities Design and implement scalable data pipelines using Lakeflow and Databricks Asset Bundles Develop high-volume ingestio...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Data Engineer - Maryland

    Senior Data Engineer - Maryland

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer.Key Responsibilities Design and implement Azure Synapse Analytics solutions and operationalize Medallion Architecture Ingest, integrate, and transform da...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Sr. Biometrics Data Engineer

    Sr. Biometrics Data Engineer

    Syneos Health / inVentiv Health Commercial LLC • Miami, FL, United States
    [job_card.full_time]
    Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Maryland Licensed Data Engineer

    Maryland Licensed Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer to design, build, and maintain data infrastructure for a public health organization. Key Responsibilities Design, implement, and maintain Azure Synapse Ana...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Olympia Heights, Florida, United States
    [job_card.full_time]
    A company is looking for a Senior Data Engineer.Key Responsibilities Design and optimize complex data systems for performance, scalability, and security Implement data modeling, ETL / ELT principl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Data Engineer

    AI Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for an AI Data Engineer.Key Responsibilities Own the full lifecycle of data processing from raw video ingestion to autonomous AI decision-making Build scalable data pipeline...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for an AWS Data Engineer.Key Responsibilities Design and implement dimensional and normalized data models optimized for analytical workloads Build and manage modern data lak...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Miami, Florida, United States
    [job_card.full_time]
    A company is looking for a Lead Data Engineer specializing in Databricks Migration.Key Responsibilities Design scalable data architectures and models while ensuring data quality and governance L...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Nebraska Licensed Cloud Data Engineer

    Nebraska Licensed Cloud Data Engineer

    VirtualVocations • Olympia Heights, Florida, United States
    [job_card.full_time]
    A company is looking for a Cloud Data Engineer to support the Data Team at the Department of Health and Human Services (DHHS) for the State of Nebraska. Key Responsibilities Complete analysis, des...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]