Principal Data Engineer
Principal Data Engineer – Waltham, MA
Our client is seeking a Principal Data Engineer to lead a project that involves the design and creation of a Data Lake in conjunction with AWS. This advisory level role will consist of about 70% architecture and 30% coding, and will also involve building automated pipelines and data services to validate, catalog, aggregate and transform ingested data.
- 10 years of experience in developing and architecting solutions specific to Big Data and Data Warehousing
- 3+ years of hands-on experience developing data lake solutions using AWS
- Experience with Python
- Experience with data streaming technologies (Kinesis, Storm, Kafka, Spark Streaming) and real time analytics
- Experience working with DevOps practices, SaaS, IaaS, and both code management and deployment tools