Scott’s Cheap Flights is a bootstrapped, profitable, travel tech startup that is on a mission to help people travel and experience the world. Our 55+ person team is fully distributed and has been for the past six years.

Scott’s Cheap Flights is hiring for a Data Engineer II. As the world’s favorite cheap flight alert platform, we’re constantly looking for ways to improve our members’ experience. This role will build and optimize a distributed data platform for machine learning and is an experienced data wrangler who enjoys optimizing data systems and building them from the ground up.

In the short term, you will:

• • Partner with leadership, engineers, marketing, product, and data analysts to understand data needs.
  • Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
  • Build and manage data collection and ELT pipelines with a focus on data quality
  • Identify, design, and implement internal data architecture and process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, and more.

In the long term, you will:

• • With the guidance and cooperation of the data analytics team, assemble large, complex data sets that meet functional / non-functional business requirements.
  • Participate in data governance implementation and strategy
  • Build continuous integration / continuous deploy (CI/CD) pipelines for dashboards and datasets for the organization ensuring change management and version control for data assets

What you know:

• • • Bachelor’s degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering)or 5+ years professional experience in data engineering
    • 3+ years of experience in scripting languages like Python etc.
    • 3+ years of SQL experience.
    • Excellent communication skills and ability to work with business owners to develop and define key business questions and to build data sets that answer those questions.
    • Strong analytic skills related to working with structured and unstructured datasets.
    • Experience with Big Data technologies e.g. Hadoop, Hive, Spark.
    • Experience using dbt to build data pipelines.
    • Experience in working and delivering end-to-end projects independently.
    • At least one BI Tool (Metabase, Superset, Tableau, PowerBI, Looker, Qlik, Kibana, Sisense)

Preferred:

• • Experience with AWS or better yet, certifications in AWS services.
  • Experience with ETL, Data Modeling, Data Integration, Scripting, and working with large-scale data sets. Extremely proficient in writing efficient SQL on and working with large data volumes.
  • Experience driving architecture and tooling focused on data quality and validation.
  • Experience with subscription business models
  • Experience tracking data lineage, using automated tests to ensure data quality, and implementing tools and processes that improve the discoverability of data.
  • Experience with workflow orchestration tools (e.g. Apache Airflow, AWS Step Functions)
  • Experience with streaming technologies such as Kafka or Event Hub
  • Experience using Snowflake or Google Big Query as a data warehouse.
  • Experience with Apache Spark or other distributed compute systems
  • Experience with notebook-based Data Science workflow.
  • Experience in the travel industry