About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions. We believe in working collaboratively with our clients and employees to achieve success.
DS Technologies Inc is looking for
Full Stack Developer OpenSearch Development role
for one of our premier clients.
Job Title: Full Stack Developer OpenSearch DevelopmentTeam: OpenSearch Development Position Type: Contract
Only W2 Role Summary The
OpenSearch Developer / Data Engineer will design, build, and maintain large-scale data ingestion, transformation, and indexing pipelines supporting T-Mobile’s observability and analytics ecosystem. This role is responsible for migrating critical network telemetry and log data from
Splunk to OpenSearch, implementing efficient ETL processes, and ensuring high-performing, scalable, and secure data workflows.
The engineer will collaborate closely with data scientists, architects, and application developers to optimize search performance, enforce data governance, and reduce operational cost while ensuring reliable and actionable insights from network data.
Key Responsibilities1. Data Engineering & ETL Development - Design and implement ETL (Extract, Transform, Load) processes to handle complex data ingestion workflows.
- Develop data pipelines to collect, normalize, and route high-volume log and telemetry data from multiple sources (network, OSS/BSS, application systems).
- Migrate existing data sets from Splunk to OpenSearch, ensuring data integrity, consistency, and traceability.
- Optimize ingestion and query performance through indexing, partitioning, and caching strategies.
2. OpenSearch Integration & Administration - Configure, manage, and maintain OpenSearch clusters, ensuring scalability, fault tolerance, and performance optimization.
- Design and implement indexing strategies and mappings for high-volume network data.
- Implement fine-grained access control, data lifecycle management, and retention policies.
- Create dashboards and analytics visualizations for operational insights, where applicable.
3. Application & Microservices Development - Develop Java-based backend services and utilities that support data ingestion, query processing, and API integrations.
- Write efficient scripts and automation utilities using Python, Perl, or JavaScript for ETL orchestration and validation.
- Develop and maintain Kafka producers/consumers for real-time event streaming and data flow into OpenSearch.
4. Quality, Testing & Deployment - Write and execute unit, integration, and performance tests to validate data migration and ingestion workflows.
- Implement CI/CD automation using GitLab pipelines for build, test, and deployment.
- Deploy services and data pipelines in Linux-based environments, ensuring robust monitoring and rollback capabilities.
- Troubleshoot data ingestion or indexing issues and optimize for minimal latency and maximum reliability.
5. Governance, Documentation & Collaboration - Establish data governance standards to ensure only relevant and useful data is logged and retained in OpenSearch.
- Document system architecture, APIs, data schemas, ETL workflows, and deployment pipelines.
- Work with architects, data scientists, and observability leads to align OpenSearch development with broader platform goals.
- Contribute to the team’s knowledge base and technical best practices for maintainability and future scalability.
Required Skills & ExperienceCore Technical Skills - Programming Languages: Java, Python, JavaScript, Perl
- Data Engineering: ETL workflow design, data transformation, and ingestion pipeline management
- Search Technologies: OpenSearch (or Elasticsearch), index tuning, query optimization, cluster scaling
- Streaming: Kafka (producers, consumers, schema design, delivery guarantees)
- Version Control & CI/CD: GitLab
- Operating Systems: Linux (shell scripting, deployment automation, monitoring)
Preferred Experience - Migration of large data volumes from Splunk to OpenSearch or similar observability platform transitions
- Experience managing 100% network data ingestion pipelines or high-throughput log management systems
- Familiarity with data retention and governance best practices for observability data
- Understanding of telecom network operations, monitoring, and telemetry data structures
Soft Skills & Collaboration - Strong analytical and problem-solving abilities for large-scale data systems.
- Excellent communication and documentation skills to interface with cross-functional teams.
- Ability to work independently while maintaining tight collaboration with onshore and offshore counterparts.
- Proven capability to deliver results under tight deadlines in a dynamic environment.
Success Outcomes - Successful migration of 100% network data from Splunk to OpenSearch with full operational continuity.
- Optimized OpenSearch clusters delivering faster query performance and reduced data latency.
- Automated, reliable ETL pipelines that improve developer velocity and reduce manual effort.
- Effective data governance—only useful, high-value data is logged and retained.
- Reduced licensing and infrastructure costs through efficient OpenSearch utilization.
- Improved observability and insights supporting proactive monitoring and faster issue resolution.
Reporting & Collaboration - Reports to the OpenSearch Development Lead / Observability Architect.
- Works closely with the Axiom, OneConsole, and SRE/Observability teams.
- Participates in Agile ceremonies (sprint planning, stand-ups, retrospectives) and documentation reviews.
Interview Focus - ETL and data pipeline design (architecture, throughput, error handling, scaling).
- OpenSearch or Elasticsearch administration and performance tuning.
- Java/Python coding test or live exercise.
- Kafka integration scenarios and troubleshooting.
- Data governance and migration strategy discussions.
This is a remote position.
){kind=logo}
){kind=logo}
