Talent.com
Senior Software Engineer - Data Lakehouse Infrastructure
Senior Software Engineer - Data Lakehouse InfrastructureTRM Labs • Providence, RI, United States
[error_messages.no_longer_accepting]
Senior Software Engineer - Data Lakehouse Infrastructure

Senior Software Engineer - Data Lakehouse Infrastructure

TRM Labs • Providence, RI, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Software Engineer

TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business and our profit as a way to move towards our mission sustainably and at scale.

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.

The impact you'll have here :

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
  • Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
  • Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
  • Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM's products.

What we're looking for :

  • Bachelor's degree (or equivalent) in Computer Science or a related field.
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
  • Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
  • Versatility that spans the entire spectrum of data engineering in one or more of the following areas :
  • In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
  • Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
  • Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
  • Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
  • Proven ability in loading, querying, and transforming extensive datasets
  • About the Team :

  • The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
  • We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
  • We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
  • We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
  • Team members are based in the US across almost all timezones! Our on-call tends to be in EST / PST shift, whatever suits you best.
  • We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours / week in meetings.
  • Learn about TRM Speed in this position :

  • Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling / updating of clusters, etc.
  • Enable tasks to be faster next time and reducing dependency on a single person.
  • Identify ways to compress timelines using 80 / 20 principle. For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
  • Identify first version, a.k.a., skateboards for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  • About TRM's Engineering Levels :

    Engineer : Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

    Senior Engineer : Successfully designs and documents system improvements and features for an OKR / project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

    Staff Engineer : Drives scoping and execution of one or more OKRs / projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

    Life at TRM Labs

    Leadership Principles :

    Our Leadership Principles are foundational element of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

  • Impact-Oriented Trailblazer : We put customers first, driving for speed, focus, and adaptability.
  • Master Craftsperson : We prioritize speed, high standards, and distributed ownership.
  • Inspiring Colleague : We value humility, candor, and a one-team mindset.
  • Build a Career :

    Joining TRM means being part of a mission-driven team comprised of industry leaders. At TRM, you'll experience :

  • Purpose and Mission : Have a real-world impact, from disrupting terrorist networks to returning stolen funds.
  • Inspiring Colleagues : Collaborate with industry leaders and learn something new daily.
  • Personal Growth : We're not just using technology; we're inventing it and taking category-defining products to market.
  • Work Environment :

  • Remote First : Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding. Clear communication is key in our decentralized setup. With tools like Slack, Loom, and voice notes, we document meetings and decisions, promoting transparency and efficiency.
  • Ownership & TRM Speed : Small teams drive big goals at TRM. Every team member has significant ownership and responsibility, fostering an environment of initiative and direct impact. While there's no strict clocking in or out, we expect team members to balance personal schedules and team needs. We move "surprisingly fast" while maintaining a high bar in service of our customers and mission. This can feel both intense and rewarding. Our unique approach to projects emphasizes quick wins, rapid iterations, and constant feedback.
  • Diversity and Inclusion : Diversity at TRM encompasses backgrounds, experiences, and perspectives. Every day is an opportunity to learn from a colleague, whether they're a law enforcement expert or a tech pioneer.
  • Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers.
  • Join Us :

    We're looking for team members who love building from the ground up and want to work hard in a fast-paced and ambitious environment. We are remote-first, with exceptionally talented team members located around the world. If you like solving tough

    [job_alerts.create_a_job]

    Senior Software Engineer Data Lakehouse Infrastructure • Providence, RI, United States

    [internal_linking.similar_jobs]
    Senior Principal Technical Program Manager, Oracle Cloud Infrastructure

    Senior Principal Technical Program Manager, Oracle Cloud Infrastructure

    Oracle • Providence, RI, United States
    [job_card.full_time]
    Senior Principal Technical Program Manager (TPM), Oracle Cloud Infrastructure.Are you an innovative thinker ready to tackle complex challenges? Join us as our Senior Principal Technical Program Man...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Application Developer

    Senior Application Developer

    Apptad Inc • RI, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MessageBody"> Job Title : Senior Application Developer Job Location : Rhode Island (REMOTE) ...[show_more]
    [last_updated.last_updated_variable_days]
    : Full Stack Engineer (60 / 40 FE / BE) SMT

    : Full Stack Engineer (60 / 40 FE / BE) SMT

    Argyllinfotech • RI, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Hi Greetings! Hope you are doing well, Please find below the details & let me know if you are Interested in this position.Com [show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Data & Analytics Engineer

    Data & Analytics Engineer

    MojoTech • Providence, RI, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MojoTech, established in 2008, is an innovative digital consulting company that integrates strategy, design, and engineering to create results-driven digital products and experiences for clients na...[show_more]
    [last_updated.last_updated_30]
    Senior Data Architecture Leader

    Senior Data Architecture Leader

    UKG (Ultimate Kronos Group) • Providence, RI, United States
    [job_card.full_time]
    A leading workforce management company in Providence, Rhode Island, is looking for an experienced Enterprise Architect-Data to drive the enterprise-wide data strategy. This position requires extensi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer

    Software Engineer

    MojoTech • Providence, RI, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MojoTech, established in 2008, is an innovative digital consulting company that integrates strategy, design, and engineering to create results-driven digital products and experiences for clients na...[show_more]
    [last_updated.last_updated_30]
    AI Data Engineer

    AI Data Engineer

    C the Signs • RI, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our LLMs and machine learning models. This individual will be responsible for the entire data lifecycle...[show_more]
    [last_updated.last_updated_30]
    Senior Manager, Geospatial Technology

    Senior Manager, Geospatial Technology

    CDM Smith • Pawtucket, RI, United States
    [job_card.full_time]
    CDM Smith is seeking a Geospatial Technology Leader to join our Digital Engineering Solutions team.This individual will lead the Geospatial Technology group within the Digital Engineering Solutions...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Computer Engineer III - Newport, RI

    Computer Engineer III - Newport, RI

    Predicate Logic Inc. • Newport, RI, USA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Predicate Logic is looking for a motivated.Founded in 1992, Predicate Logic is a woman-owned, employee-owned, high technology engineering service company. Predicate Logic's employees routinely recei...[show_more]
    [last_updated.last_updated_30]
    Senior Manager, Data Loss Prevention

    Senior Manager, Data Loss Prevention

    Coinbase • Providence, RI, United States
    [job_card.full_time]
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Systemss Engineer

    Systemss Engineer

    Rite-Solutions, Inc. • Newport, RI, USA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    This position requires working both at our Rite-Solutions office in Middletown, RI and on-site at the customer location in Naval Undersea Warfare Center in Newport, RI. This position will provide di...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Knowledge Leader - VA Federal Consulting / Oracle Health

    Senior Knowledge Leader - VA Federal Consulting / Oracle Health

    Ll Oefentherapie • Providence, RI, United States
    [job_card.full_time]
    We are looking for an experienced solution consultant to help design, configure, activate and support the education, knowledge sharing, and product release communications for our internal solution ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    C the Signs • RI, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing, model trai...[show_more]
    [last_updated.last_updated_30]
    Senior Technical Program Manager - Oracle Cloud Infrastructure

    Senior Technical Program Manager - Oracle Cloud Infrastructure

    Oracle • Providence, RI, United States
    [job_card.full_time]
    Join Oracle Cloud Infrastructure (OCI) at the forefront of our global cloud expansion.As a Program Manager, you will shape OCI's growth strategy by driving complex, high-impact operational initiati...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer I

    Software Engineer I

    SEACORP • Newport, RI, US
    [job_card.full_time]
    SEACORP is seeking a well?qualified Software Engineer I.This entry?level role requires the ability to obtain a DoD Secret Clearance. The position is based in Middletown, RI.Primary Duties and Respon...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Neo4j Senior Lead

    Neo4j Senior Lead

    Argyllinfotech • RI, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Hi Greetings! Hope you are doing well, Please find below the details & let me know if you are Interested in this position.Com [show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Senior Systems Engineer PTOC

    Senior Systems Engineer PTOC

    Rite-Solutions, Inc. • Newport, RI, USA
    [job_card.part_time]
    [filters_job_card.quick_apply]
    Level 2 certified organization.We are innovative, growing and adhere to the highest standards for handling controlled unclassified information (CUI). We value the experience of the employee, their w...[show_more]
    [last_updated.last_updated_variable_days]
    M-78-Data Architect 144227.

    M-78-Data Architect 144227.

    FHR • Warwick, RI, US
    [job_card.temporary]
    [filters_job_card.quick_apply]
    Data Architect (Job ID : 144227).Location : Hybrid – Augusta, ME (Onsite once per month; candidates in New England preferred). Travel : Client does not cover travel expensesOur direct client in Augusta...[show_more]
    [last_updated.last_updated_30]