Talent.com
Senior Software Engineer, Data Platform
Senior Software Engineer, Data PlatformCastle Island Co • Mission, KS, United States
Senior Software Engineer, Data Platform

Senior Software Engineer, Data Platform

Castle Island Co • Mission, KS, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business and our profit as a way to move towards our mission sustainably and at scale.

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.

Responsibilities

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
  • Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
  • Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
  • Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRMs products.

What were looking for

  • Bachelor's degree (or equivalent) in Computer Science or a related field.
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
  • Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
  • Versatility that spans the entire spectrum of data engineering in one or more of the following areas :
  • In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.

  • Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
  • Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
  • Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
  • Proven ability in loading, querying, and transforming extensive datasets
  • About the Team

  • The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
  • We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
  • We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
  • We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
  • Team members are based in the US across almost all timezones! Our on-call tends to be in EST / PST shift, whatever suits you the best.
  • We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours / week in meetings.
  • Learn about TRM Speed in this position

  • Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling / updating of clusters, etc.
  • Enable tasks to be faster next time and reducing dependency on a single person.
  • Identify ways to compress timelines using 80 / 20 principle . For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
  • Identify first version, a.k.a., " skateboards " for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  • About TRM's Engineering Levels

    Engineer : Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

    Senior Engineer : Successfully designs and documents system improvements and features for an OKR / project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

    Staff Engineer : Drives scoping and execution of one or more OKRs / projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

    Life at TRM Labs

    Leadership Principles

    Our Leadership Principles are foundational element of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

  • Impact-Oriented Trailblazer : We put customers first, driving for speed, focus, and adaptability.
  • Master Craftsperson : We prioritize speed, high standards, and distributed ownership.
  • Inspiring Colleague : We value humility, candor, and a one-team mindset.
  • Build a Career

    Joining TRM means being part of a mission-driven team comprised of industry leaders. At TRM, you'll experience :

  • Purpose and Mission : Have a real-world impact, from disrupting terrorist networks to returning stolen funds.
  • Inspiring Colleagues : Collaborate with industry leaders and learn something new daily.
  • Personal Growth : We're not just using technology; we're inventing it and taking category-defining products to market.
  • Work Environment

  • Remote First : Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding. Clear communication is key in our decentralized setup. With tools like Slack, Loom, and voice notes, we document meetings and decisions, promoting transparency and efficiency.
  • Ownership & TRM Speed : Small teams drive big goals at TRM. Every team member has significant ownership and responsibility, fostering an environment of initiative and direct impact. While there's no strict clocking in or out, we expect team members to balance personal schedules and team needs. We move surprisingly fast while maintaining a high bar in service of our customers and mission. This can feel both intense and rewarding. Our unique approach to projects emphasizes quick wins, rapid iterations, and constant feedback.
  • Diversity and Inclusion : Diversity at TRM encompasses backgrounds, experiences, and perspectives. Every day is an opportunity to learn from a colleague, whether they're a law enforcement expert or a tech pioneer.
  • Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers.
  • Join Us

    We're looking for team members who love building from the ground up and want to work hard in a fast-paced and ambitious environment. We are remote-first, with exceptionally talented team members located around the world. If you like solving tough problems quickly and seeing your work improve the lives of billions of people, we want you at TRM.

    We encourage you to reach out even if your experience doesn't precisely match the job description. Don't worry about picking exactly the right job; we can always explore other options after starting the conversation. Your passion and interests will set you apart, especially if your background or career is unconventional.

    To all recruitment agencies : TRM Labs does not accept unsolicited agency resumes. Please do not forward resumes to TRM Labs employees. TRM Labs is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Senior Software Engineer Platform • Mission, KS, United States

    Job_description.internal_linking.related_jobs
    Senior Software Engineer

    Senior Software Engineer

    Kaav Inc. • Leawood, KS, United States
    serp_jobs.job_card.full_time
    As a Senior Software Engineer you will have responsibility for developing, testing, implementing, and maintaining software applications in a for-profit organization utilizing Microsoft technologies...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer

    Senior Software Engineer

    Propio Language Services • Overland Park, KS, United States
    serp_jobs.job_card.full_time
    Our people take pride in every resource we offer, and our users always have access to the best technology, support, and experience. We are driven by our passion for innovation, growth, and connectin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer - PSI Solutions

    Senior Software Engineer - PSI Solutions

    Educational Testing Service • Olathe, KS, United States
    serp_jobs.job_card.full_time
    ETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready.For more than 75 years, we've been advancing the science of measurement to build ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer - Backend

    Senior Software Engineer - Backend

    HavocAI Inc. • Mission, KS, United States
    serp_jobs.job_card.full_time
    Collaborative autonomy is how self-tasking teams of machines will solve hard human problems, and HavocAI is an unquestioned leader in collaborative autonomy. We set the standard for autonomous surfa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer

    Senior Software Engineer

    Relativity • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    The Senior Software Engineer - aiR for Review designs, builds, and operates the next generation of generative AI-driven, cloud-native web applications that are transforming our business and industr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer

    Senior Software Engineer

    Propio • Overland Park, Kansas, United States
    serp_jobs.job_card.full_time
    Our people take pride in every resource we offer, and our users always have access to the best technology, support, and experience. We are driven by our passion for innovation, growth, and connectin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer, Data Pipeline Engineering

    Software Engineer, Data Pipeline Engineering

    Cboe Digital • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    Building trusted markets — powered by our people.At Cboe Global Markets, we inspire our people to solve complex challenges together because what we do matters. We provide the financial infrastructur...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer, Data Pipeline Engineering

    Software Engineer, Data Pipeline Engineering

    Cboe Global Markets • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    Building trusted markets - powered by our people.At Cboe Global Markets, we inspire our people to solve complex challenges together because what we do matters. We provide the financial infrastructur...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer

    Senior Software Engineer

    Children's Mercy KC • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    Thanks for your interest in Children's Mercy!.Do you envision finding a meaningful role with an inclusive and compassionate team? At Children's Mercy, we believe in making a difference in the lives...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer

    Senior Software Engineer

    TEKsystems • Kansas City, MO, United States
    serp_jobs.job_card.permanent
    IPFS is looking for an innovative and modernization-minded engineer to re-envision our entire client experience.This person will join a collaborative and design-driven team, with talent and tenure ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Forward Deployed Software Engineer-Palantir Foundry-Manager

    Forward Deployed Software Engineer-Palantir Foundry-Manager

    PwC • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Fullstack

    Senior Software Engineer, Fullstack

    Mediafly • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    Senior Software Engineer, Fullstack.Mediafly is the leading revenue enablement platform market-facing teams use to plan, predict, coach, and engage at the highest levels. Our unified suite of soluti...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    TriCom Technical Services • Lenexa, KS, United States
    serp_jobs.job_card.temporary
    Data Governance Engineer to drive the implementation and auditing of enterprise data governance policies, focused on compliance, security, and discoverability within Microsoft Fabric.This individua...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Senior Software Engineer, Core Experiences - Overland Park, USA

    Senior Software Engineer, Core Experiences - Overland Park, USA

    Speechify • Overland Park, KS, United States
    serp_jobs.job_card.full_time
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the go,...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Database Infrastructure

    Senior Software Engineer, Database Infrastructure

    Hedera Hashgraph • Mission, KS, United States
    serp_jobs.job_card.full_time
    TRM is on a mission to build a safer financial system for billions of people.We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior Software Engineer - Overland Park, KS.

    Senior Software Engineer - Overland Park, KS.

    Taurus Services LLC • Overland Park, KS, United States
    serp_jobs.job_card.full_time
    Backed by decades of expertise, Taurus is a pioneering force in the insurance sector, leading industry transformation through its three distinct subcompanies. Taurus Technologies, the flagship arm, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer (Lenexa)

    Senior Data Engineer (Lenexa)

    TriCom Technical Services • Lenexa, KS, United States
    serp_jobs.job_card.temporary
    Data Governance Engineer to drive the implementation and auditing of enterprise data governance policies, focused on compliance, security, and discoverability within Microsoft Fabric.This individua...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Senior Software Engineer - Epic Bridges

    Senior Software Engineer - Epic Bridges

    Children's Mercy Kansas City • Kansas City, MO, United States
    serp_jobs.job_card.full_time
    Thanks for your interest in Children's Mercy!.Do you envision finding a meaningful role with an inclusive and compassionate team? At Children’s Mercy, we believe in making a difference in the lives...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted