ShyftLabs Announces Official OpenAI Partnership
ShyftLabs
ShyftLabs announced that it became an official OpenAI partner as it expands enterprise AI solutions and production deployments.
Read articleAbout ShyftLabs
At ShyftLabs, we live and breathe data. Since 2020, we’ve been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable business impact. We’re growing fast and we’re looking for passionate problem-solvers who are ready to turn big ideas into real outcomes.
The Opportunity
ShyftLabs is seeking a skilled Data Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven insights and ensure scalable, high-performance data architectures.
Design, implement, and optimize big data pipelines in Databricks.
Develop scalable ETL workflows to process large datasets.
Leverage Apache Spark for distributed data processing and real-time analytics.
Implement data governance, security policies, and compliance standards.
Optimize data lakehouse architectures for performance and cost-efficiency.
Collaborate with data scientists, analysts, and engineers to enable advanced AI/ML workflows.
Monitor and troubleshoot Databricks clusters, jobs, and performance bottlenecks.
Automate workflows using CI/CD pipelines and infrastructure-as-code practices.
Ensure data integrity, quality, and reliability in all pipelines.
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
5+ years of hands-on experience with Databricks and Apache Spark.
Proficiency in SQL, Python, or Scala for data processing and analysis.
Experience with cloud platforms (AWS, Azure, or GCP) for data engineering.
Strong knowledge of ETL frameworks, data lakes, and Delta Lake architecture.
Experience with CI/CD tools and DevOps best practices.
Familiarity with data security, compliance, and governance best practices.
Strong problem-solving and analytical skills with an ability to work in a fast-paced environment.
Databricks certifications (e.g., Databricks Certified Data Engineer, Spark Developer).
Hands-on experience with MLflow, Feature Store, or Databricks SQL.
Exposure to Kubernetes, Docker, and Terraform.
Experience with streaming data architectures (Kafka, Kinesis, etc.).
Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).
Prior experience working with retail, e-commerce, or ad-tech data platforms.
This Data Engineer role builds and maintains scalable data pipelines on Databricks, with a focus on Spark-based processing, cloud data engineering, and lakehouse performance. The work also supports trustworthy data and downstream analytics and AI/ML workflows across teams.
ShyftLabs builds enterprise data and AI systems for organizations in retail, healthcare, financial services, energy, government, manufacturing and supply chain. Its work spans applied intelligence, data infrastructure and engineering, activation and analytics, and governance and security. The company also develops Continuum, an agentic AI platform comprising an open-source agent runtime, Aura for intelligent model routing, and Provenance for governance and observability. ShyftLabs says it has launched more than 50 enterprise solutions and employs more than 250 data and AI specialists across locations including Toronto, New York, Dubai and India.
ShyftLabs offers candidates exposure to enterprise AI, data engineering and agentic AI projects used by major retailers, healthcare organizations and public-sector clients. The company says it has more than 250 data and AI specialists and has launched over 50 enterprise solutions. Its Continuum platform includes an open-source agent runtime, intelligent model routing and AI governance, creating work across agents, distributed systems, data infrastructure and security. Current roles reference Python, Databricks, Spark, AWS, Azure, GCP, Terraform and Kubernetes. Job postings also highlight technical ownership, mentoring, professional development, employer-paid health benefits in Canada and hybrid flexibility for applicable roles.
Programming Language
Backend Framework
Frontend Framework
Database
Database
Data and AI Platform
Data Processing
Data Processing
Data Platform
Cloud Data Platform
Data Transformation
Data Orchestration
Cloud Infrastructure
Cloud Infrastructure
Cloud Infrastructure
Infrastructure as Code
Containers
Container Orchestration
Workflow Orchestration
Vector Database
Vector Database
AI Observability
Machine Learning Platform
Cloud Data Warehouse
Founder and CEO of ShyftLabs with a background in analytics, product and retail technology. Before founding ShyftLabs, Khandelwal worked at companies including Jet.com, Citi and Evernote and co-founded Minoan. He holds an MS in Operations Research from Columbia University and a BE in Computer Science from Panjab University.
Leads security and privacy initiatives at ShyftLabs and contributes to the company's enterprise AI governance work. His background includes software engineering, application security, penetration testing and cloud security, with prior cybersecurity experience at KPMG and professional certifications across AWS and Google Cloud.
Leads consulting and services at ShyftLabs, helping translate enterprise business requirements into data, AI and digital transformation programs. His background includes product management, consulting and entrepreneurship, including co-founding healthcare technology venture InsightHx.
ShyftLabs
ShyftLabs announced that it became an official OpenAI partner as it expands enterprise AI solutions and production deployments.
Read articleShyftLabs
ShyftLabs introduced Aura, a model-routing layer within Continuum that can route AI requests across more than 250 models and 45 providers according to quality, latency, cost and policy requirements.
Read articleShyftLabs
ShyftLabs disclosed its work on the data foundation supporting MAC Cosmetics' Shopify storefront, including real-time activation, consent and privacy enforcement and unified customer profiles.
Read articleShyftLabs
ShyftLabs hosted AgentShyft during Toronto Tech Week, where developers built production-oriented agentic AI applications using the company's Continuum framework.
Read articleShyftLabsToronto, CanadaFull time
ShyftLabsToronto, CanadaFull time
ShyftLabsRemoteFull time
ShyftLabsCoimbatore, IndiaFull time
ShyftLabsToronto, CanadaFull time
ShyftLabsToronto, Ontario, Canada; Calgary, Alberta, CanadaFull time
ShyftLabsNoida, IndiaFull time
ShyftLabsNoida, IndiaFull time