Talent.com
Senior Software Engineer - Data Lakehouse Infrastructure
Senior Software Engineer - Data Lakehouse InfrastructureTRM Labs • Providence, RI, United States
[error_messages.no_longer_accepting]
Senior Software Engineer - Data Lakehouse Infrastructure

Senior Software Engineer - Data Lakehouse Infrastructure

TRM Labs • Providence, RI, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Software Engineer

TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business and our profit as a way to move towards our mission sustainably and at scale.

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.

The impact you'll have here :

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
  • Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
  • Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
  • Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM's products.

What we're looking for :

  • Bachelor's degree (or equivalent) in Computer Science or a related field.
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
  • Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
  • Versatility that spans the entire spectrum of data engineering in one or more of the following areas :
  • In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
  • Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
  • Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
  • Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
  • Proven ability in loading, querying, and transforming extensive datasets
  • About the Team :

  • The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
  • We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
  • We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
  • We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
  • Team members are based in the US across almost all timezones! Our on-call tends to be in EST / PST shift, whatever suits you best.
  • We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours / week in meetings.
  • Learn about TRM Speed in this position :

  • Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling / updating of clusters, etc.
  • Enable tasks to be faster next time and reducing dependency on a single person.
  • Identify ways to compress timelines using 80 / 20 principle. For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
  • Identify first version, a.k.a., skateboards for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  • About TRM's Engineering Levels :

    Engineer : Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

    Senior Engineer : Successfully designs and documents system improvements and features for an OKR / project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

    Staff Engineer : Drives scoping and execution of one or more OKRs / projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

    Life at TRM Labs

    Leadership Principles :

    Our Leadership Principles are foundational element of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

  • Impact-Oriented Trailblazer : We put customers first, driving for speed, focus, and adaptability.
  • Master Craftsperson : We prioritize speed, high standards, and distributed ownership.
  • Inspiring Colleague : We value humility, candor, and a one-team mindset.
  • Build a Career :

    Joining TRM means being part of a mission-driven team comprised of industry leaders. At TRM, you'll experience :

  • Purpose and Mission : Have a real-world impact, from disrupting terrorist networks to returning stolen funds.
  • Inspiring Colleagues : Collaborate with industry leaders and learn something new daily.
  • Personal Growth : We're not just using technology; we're inventing it and taking category-defining products to market.
  • Work Environment :

  • Remote First : Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding. Clear communication is key in our decentralized setup. With tools like Slack, Loom, and voice notes, we document meetings and decisions, promoting transparency and efficiency.
  • Ownership & TRM Speed : Small teams drive big goals at TRM. Every team member has significant ownership and responsibility, fostering an environment of initiative and direct impact. While there's no strict clocking in or out, we expect team members to balance personal schedules and team needs. We move "surprisingly fast" while maintaining a high bar in service of our customers and mission. This can feel both intense and rewarding. Our unique approach to projects emphasizes quick wins, rapid iterations, and constant feedback.
  • Diversity and Inclusion : Diversity at TRM encompasses backgrounds, experiences, and perspectives. Every day is an opportunity to learn from a colleague, whether they're a law enforcement expert or a tech pioneer.
  • Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers.
  • Join Us :

    We're looking for team members who love building from the ground up and want to work hard in a fast-paced and ambitious environment. We are remote-first, with exceptionally talented team members located around the world. If you like solving tough

    [job_alerts.create_a_job]

    Senior Software Engineer Data Lakehouse Infrastructure • Providence, RI, United States

    [internal_linking.similar_jobs]
    Software Engineer, Android Core Product - Providence, USA

    Software Engineer, Android Core Product - Providence, USA

    Speechify • Providence, Rhode Island, United States
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, G...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Principal Technical Program Manager, Oracle Cloud Infrastructure

    Senior Principal Technical Program Manager, Oracle Cloud Infrastructure

    Oracle • Providence, RI, United States
    [job_card.full_time]
    Senior Principal Technical Program Manager (TPM), Oracle Cloud Infrastructure.Are you an innovative thinker ready to tackle complex challenges? Join us as our Senior Principal Technical Program Man...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Application Developer

    Senior Application Developer

    Apptad Inc • RI, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MessageBody"> Job Title : Senior Application Developer Job Location : Rhode Island (REMOTE) ...[show_more]
    [last_updated.last_updated_1_day]
    Data & Analytics Engineer

    Data & Analytics Engineer

    MojoTech • Providence, RI, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MojoTech, established in 2008, is an innovative digital consulting company that integrates strategy, design, and engineering to create results-driven digital products and experiences for clients na...[show_more]
    [last_updated.last_updated_30]
    M-78-Data Architect 144227.

    M-78-Data Architect 144227.

    FHR • Newport, RI, US
    [job_card.temporary]
    [filters_job_card.quick_apply]
    Data Architect (Job ID : 144227).Location : Hybrid – Augusta, ME (Onsite once per month; candidates in New England preferred). Travel : Client does not cover travel expensesOur direct client in Augusta...[show_more]
    [last_updated.last_updated_30]
    Senior Data Architecture Leader

    Senior Data Architecture Leader

    UKG (Ultimate Kronos Group) • Providence, RI, United States
    [job_card.full_time]
    A leading workforce management company in Providence, Rhode Island, is looking for an experienced Enterprise Architect-Data to drive the enterprise-wide data strategy. This position requires extensi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer

    Software Engineer

    MojoTech • Providence, RI, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MojoTech, established in 2008, is an innovative digital consulting company that integrates strategy, design, and engineering to create results-driven digital products and experiences for clients na...[show_more]
    [last_updated.last_updated_30]
    AI Data Engineer

    AI Data Engineer

    C the Signs • RI, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our LLMs and machine learning models. This individual will be responsible for the entire data lifecycle...[show_more]
    [last_updated.last_updated_30]
    Restaurant Delivery - Onboarding / Onboard

    Restaurant Delivery - Onboarding / Onboard

    DoorDash • Bellingham, MA, United States
    [job_card.full_time] +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a var...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead -Senior Front-End Engineer

    Lead -Senior Front-End Engineer

    NextTA • Providence, Rhode Island, United States
    [job_card.full_time]
    A global leader in communications and digital transformation, this organization delivers enterprise-grade technology solutions across managed connectivity, unified communications, cloud services, a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager, Geospatial Technology

    Senior Manager, Geospatial Technology

    CDM Smith • Pawtucket, RI, United States
    [job_card.full_time]
    CDM Smith is seeking a Geospatial Technology Leader to join our Digital Engineering Solutions team.This individual will lead the Geospatial Technology group within the Digital Engineering Solutions...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Core Experiences - Providence, USA

    Senior Software Engineer, Core Experiences - Providence, USA

    Speechify • Providence, Rhode Island, United States
    [job_card.full_time]
    Speechify is the easiest way to listen to the world’s information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the go,...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Computer Engineer III - Newport, RI

    Computer Engineer III - Newport, RI

    Predicate Logic Inc. • Newport, RI, USA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Predicate Logic is looking for a motivated.Founded in 1992, Predicate Logic is a woman-owned, employee-owned, high technology engineering service company. Predicate Logic's employees routinely recei...[show_more]
    [last_updated.last_updated_30]
    Senior Manager, Data Loss Prevention

    Senior Manager, Data Loss Prevention

    Coinbase • Providence, RI, United States
    [job_card.full_time]
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Systems Development Engineer

    Principal Systems Development Engineer

    Dell • Attleboro, Massachusetts, United States
    [job_card.full_time]
    Principal Systems Development Engineer.Our customers' systems are highly complex, and minimizing downtime is paramount.Operating from our Round Rock, TX location, the Principal D4D Sustaining ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    C the Signs • RI, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing, model trai...[show_more]
    [last_updated.last_updated_30]
    Software Engineer I

    Software Engineer I

    SEACORP • Newport, RI, US
    [job_card.full_time]
    SEACORP is seeking a well?qualified Software Engineer I.This entry?level role requires the ability to obtain a DoD Secret Clearance. The position is based in Middletown, RI.Primary Duties and Respon...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Technical Program Manager - Oracle Cloud Infrastructure

    Senior Technical Program Manager - Oracle Cloud Infrastructure

    Oracle • Providence, RI, United States
    [job_card.full_time]
    Join Oracle Cloud Infrastructure (OCI) at the forefront of our global cloud expansion.As a Program Manager, you will shape OCI's growth strategy by driving complex, high-impact operational initiati...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]