Description

Job Title: Data Engineer

The Data Engineer will be responsible for implementing complex data ingestion and pipeline processes on Google Cloud Platform (GCP), adhering to industry best practices. The role involves designing, developing, configuring, testing, debugging, and documenting these processes to meet business requirements and technical architecture specifications. The candidate will also support and troubleshoot existing processes and data flows.

• Design and implement data ingestion and pipeline workflows according to business needs and technical specifications.
• Work independently and collaboratively, keeping project teams and leaders informed.
• Prepare detailed specifications from which data processes are developed and implemented.
• Develop and implement technical solutions through code development and tool configuration.
• Use SQL for querying databases to extract data, analyze it, and troubleshoot defects.
• Responsible for the development and execution of testing plans, including unit, system, integration, and user acceptance testing. Document all results.
• Participate in project planning and may assume responsibility for managing projects of limited scope.
• Provide coding options and estimates for project planning and budget management.
• Estimate and track time required for tasks to assist with project budgeting and financial tracking.
• Conduct and participate in solution design, configuration, and code reviews.
• Provide technical expertise for both project and operational support teams.
• Adhere to strict security standards for handling, processing, and storing sensitive data.
• Maintain development standards and recommend new standards as needed.

Qualifications:

• 4-Year Bachelor’s Degree in Computer Science, Information Technology, or a related field.
• 3+ years of professional experience in data engineering with a focus on Google Cloud Platform.

Technical Skills and Qualifications:

Must have:

• Google Pub/Sub
• BigQuery
• Google Dataform
• Experience with data ingestion to BigQuery
• Google Cloud Storage
• Cloud Composer
• GitHub
• Proficiency in SQL

Good to have:

• Cloud Data Fusion
• DBMS connectivity and interaction (SQL Server, DB2, Oracle)
• Experience with RESTful APIs and SOAP Web services
• Experience integrating with other Google resources, databases, and services
• Jira
• Confluence

Before you Apply: Here is an interview Q and A for you: Click here

NOTE: Here is why some companies may not hire you.

Up Your Skill: Take Paid Courses HERE for free

Are your skills still relevant in 2025-2030? Check it out Here