Job Description : Data Engineer
Job Responsibilities :
- Design and implement data pipelines to collect and process data from various sources.
- Develop construct test and maintain architectures such as databases and large-scale processing systems.
- Ensure data quality and reliability through monitoring and troubleshooting data pipelines.
- Create and maintain optimal data pipeline architecture for both batch and real-time data processing.
- Work closely with cross-functional teams to understand and address data-related issues.
- Implement data security and privacy measures to protect sensitive information.
- Collaborate with data scientists and analysts to support their data infrastructure needs.
Essential Qualifications :
Bachelors degree in Computer Science Information Technology or related field.Proficiency in programming languages such as Python Java or Scala.Experience with big data technologies like Hadoop Spark or Kafka.Familiarity with cloud services like AWS GCP or Azure.Strong SQL skills and experience working with relational databases.Desired Experience :
Minimum of 1 year of experience working as a Data Engineer.Experience with data modeling ETL processes and data warehousing.Knowledge of machine learning and data visualization techniques.Previous work in industries such as paper & pulp textile or oil & gas is a plus.Salary & Benefits :
Salary Range : $60000 - $90000 annuallyHealth insurance dental coverage and retirement savings planPaid time off including vacation days and holidaysOpportunity for professional development and trainingKey Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Experience : years
Vacancy : 1