GCP Data Engineer in Fusemachines

Fusemachines is a leading AI strategy, talent, and education services, provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, the United States, Canada, and the Dominican Republic and more than 250 full-time employees) Fusemachines seeks to bring its global expertise in AI to transform companies around the world.

• Build, maintain and optimize data pipelines for our Enterprise Data Platform using Google Cloud Platform technologies.
• Ingest new data sources from initial discovery & data architecture, through ETL authoring, operationalizing using Dataflow, Airflow (Cloud Composer) DAGs, and post launch lifecycle.
• Research and test new big-data technologies and tools.
• Advanced SQL queries, and modeling.
• Help drive the roadmap of the Data Engineering team and Enterprise Data Platform.
• Engage vendors with required features to meet business needs.
• Leverage the full value of our vendor integrations and APIs.
• Optimize BigQuery and ETL resources to decrease spend & increase performance.
• Help guide team of engineers on best practices, standards, and toolsets to author ETL
• Engineering pipelines

• Bachelor’s degree in data science, computer science or similar majors
• 5+ years of experience in Data Engineering
• 5+ years of experience in at least one OOP language, preferably Python
• Deep SQL knowledge / experience
• Experience in complex pipeline task management (i.e., Airflow and Beam)
• Experience with Github

• Google Cloud Platform tools or equivalent platform experience using tools s/a BigQuery, Dataflow / Apache Beam, Cloud Composer / Airflow, Apache Spark, Pub/Sub
• Experience in Apache Beam
• Experience with Scala
• Experience with Scalr/Terraform
• Experience with CI/CD