Job Description/Responsibilities My company is seeking a Staff Data Engineer that will work with the development team to construct a data streaming platform and data warehouse that serves as the data foundations for the company's product. You will be a critical part of our growing company, working on a cross-functional team to implement best practices in technology, architecture, and process.
Build our next generation data warehouse
Build our event stream platform
Translate user requirements for reporting and analysis into actionable deliverables
Enhance automation, operation, and expansion of real-time and batch data environment
Extract, transform, and load complex data into the data warehouse using cutting-edge technologies
Build processes for topnotch security, performance, reliability, and accuracy
Skills/Qualifications
10+ years of experience building data pipelines as a Data Engineer or Software Engineer
4+ years of experience building data frameworks for unit testing, data lineage tracking, and automation
Fluency in Scala and at least one other server-side programming languages (e.g. Python, Java, Go)
Strongly proficient on Apache Spark
Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink)