Data Engineer

ABOUT TREDENCE Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data.JOB DESCRIPTION:We are looking for an analytical, big picture thinker who is driven to enhance and further the mission of Tredence by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. This Cloud Architect will be empowered to lead the organization to focus on implementing both top-level, strategic, innovative solutions, as well as the day-to-day tactics that drive efficiency, effectiveness and value across the entire organization. You will play a critical role in creating and analysing deliverables to provide critical content to enable fact-based decision making, facilitation and achievement of successful collaboration with the business stakeholders. You will analyse, design, and develop best practices business changes through technology solutions.THE IDEAL CANDIDATE WILL Engage with stakeholders to gather requirements to deliver data solutions. Implement data pipelines to automate the ingestion, transformation, and augmentation of data sources, and provide best practices for pipeline operations. Responsible for creating Technical Architectures for migration from OnPrem to Cloud Managing and mentoring a Team in end to end implementation of project. Capability to work in a rapidly changing business environment and to enable simplified user access to massive data by building scalable data solutionsELIGIBILITY CRITERIA Graduate degree in Computer Science, Information Systems or equivalent quantitative field and 4-6 years of experience in a similar big data experience role. Experience working with and extracting value from large, disconnected and/or unstructured datasets Demonstrated ability to build processes that support data transformation, data structures, metadata, dependency and workload management Strong interpersonal skills and ability to project manage and work with cross-functional teams Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Ability to experiment and adopt any new technologies in big data ecosystem Experience with the one or more tools and technologies: Hadoop, Hive, Spark, Pig, Scoop, Kafka, Presto, Impala, Drill, Druid, Relational SQL and NoSQL databases Data pipeline/workflow management tools such as Azkaban and Airflow Able to play around with configuration properties for performance tuning At least one Cloud Service Provider among GCP/Azure. Stream-processing systems such as Storm and Spark-Streaming Object-oriented/object function scripting languages such as Python, Scala, Java, C++, etc. Hands-on of one or more scripting language is a plusABOUT YOU: You are self-motivated, collaborative, eager to learn, and hands on You love trying out new apps, and find yourself coming up with ideas to improve them You stay ahead with all the latest trends and technologies You are particular about following industry best practices and have high standards regarding quality WHY JOIN TREDENCE?There is a reason we are one of the fastest growing private companies in the country! You will have the opportunity to work with some of the smartest, friendliest, hardest working people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our clients, some of the largest and most innovative businesses in the world. We offer a 401k match; full medical, dental and vision benefits, a fun team atmosphere and a work life balance. Our people are our greatest asset and we value every one of them. Come see why we’re so successful in one of the most competitive and fastest growing industries in the world.