Collinwood is assisting our client, one of the world's largest consumer research firms, in their efforts to hire an experienced Software Engineer, focused on Python development.
As a Software Engineer, you will be involved with teams processing large volumes of Client data. You should be well-versed in languages and databases, enabling processing and transforming large data. You will be involved in all phases of development cycles, including design, development, validation, and deployment of applications, and you are expected to be able to work with cross teams for assigned deliveries.
WH AT YOU WILL BE DOING :
- Create Python, Spark, Perl, and / or Shell Scripting programs to process data sets
- Maintain existing Python, Spark, Perl, Shell Scripts, and C programs
- Create required documentation
- Follow established SOPs and practices
- Work with other team members on the design of new modules
- Validate data generated to confirm that desired values are created
- Provide interface documentation to other team members on interfaces
WHAT WE NEED FROM YOU :
Bachelor's degree or equivalent in computer science.2-5 years of experience in Python, Perl, and C programming languagesGood understanding of Spark and PySpark is a plusGood understanding of databases such as Hive, Postgres, or OracleShould be familiar with scheduling tools such as Airflow or Control-MA passion for technology and an insatiable appetite to learn, learn-it-all attitude