Syren is looking for a Cloud Data engineer who has knowledge on GCP, Big query, Cloud Bigtable, Data flow, cloud storage, cloud composer. Candidate should be able to independently build end-to-end data pipelines which includes data ingestion, data transformations using different services in GCP.
Experience in handling big data project implementations on GCP. Other cloud experiences would be an advantage.
Primary Skills (Hands on)
1. Big query Optimization
2. Real time streaming experience
3. Building complex SQL scripts
4. PySpark
5. Python
6. Cloud Dataflow
Secondary Skills
1. Pubsub
2. Datastream /Striim
3. CDC (Change data capture)
4. Performance tuning
Responsibilities:
· Demonstrate ownership of end-to-end architecture and detailed design
· Collaborate client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform.