Data Engineer
TweetData Engineer
Name: Data Engineer
Role: Data Engineer
Industry: Software/ IT
Location: Udaipur (Rajasthan)
Job Type: Full Time
Experience: 3 - 6 years
Skills: Data Engineer, ETL/ELT processes, data ingestion, cloud platforms, big data tools, CI/CD pipelines
Salary: Best in the industry
Education: BTech (CS/IT/EC), BCA, MCA
Description:
3+ years of experience in a data engineering or related role, managing complex data workflows and large-scale datasets. Expertise in SQL, with the ability to write, optimize, and troubleshoot complex queries for relational databases like MySQL, PostgreSQL, Oracle, or Snowflake. Proficiency in Python, including libraries like Pandas, PySpark, and others used for data manipulation and processing. Experience with big data tools such as Apache Spark, Hadoop, or Kafka. Data Engineer. Familiarity with cloud platforms (AWS, Azure, GCP) and their data processing services (e.g., AWS Glue, Google BigQuery, Azure Data Factory). Strong understanding of data modeling, normalization, and schema design. Experience in using version control systems like Git for collaborative development. Knowledge of CI/CD pipelines for data workflows is a plus. Strong problem-solving skills with attention to detail and the ability to debug data issues efficiently.Design, build, and maintain scalable data pipelines and architectures for large-scale data processing. Develop and optimize ETL/ELT processes for data ingestion, transformation, and loading. Collaborate with data analysts and scientists to ensure data accessibility and usability. Monitor and improve data quality and system performance. Implement best practices for data governance, security, and compliance. Work with cross-functional teams to integrate data systems with existing and new technology stacks. Utilize distributed computing tools (e.g., Spark, Hadoop) and cloud platforms (AWS, Azure, GCP) for efficient data handling. Develop automated workflows for data validation and reporting.