Data Engineer

Data Engineer

Location : Plano TX

Duration : Long Term

Logistics : Plano based roles- normal expectations- 3 days in the office

Project & Domain is the same- Enterprise productivity- this team has built a platform for their internal teams to leverage AI

Difference between then and now- was more POC to localize parts of cap one

Now- will be moving across all of enterprise

Data Engineering skillset core :

Engineering focus- priority

Ideal to have someone that has some analysis skillset too

Only thing thats changed a bit- before it was building pipelines- Now its building pipelines and supporting

Tech Stack : SQL

Either Typescript or Python (for pipeline dev)

Kafka

Snowflake

Core Data Engineering Skills :

Experience in building data pipelines and app development including Python SQL Typescript

Experience with AWS and distributed tools (Kafka - preference optional - MapReduce Hadoop Hive EMR Spark Gurobi or MySQL)

Experience with ETL / ELT tools (Airbyte - preference Airflow etc) (big plus)

Experience working on real-time data and streaming applications (Kafka Flink etc.)

Experience with data warehousing experience ( Snowflake)

Experience with UNIX / Linux including basic commands and shell scripting

Experience with Agile engineering practices.

Data Analysis Skills Examples

SQL- beyond just building something that is used and consumed by sql what would be tables / views

Example :

Data platform challenge- things looking differently in source system vs. on the platform- why is that

Data produced by snowflake- some analysis there

Able to work in some sort of gray space

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1