Big Data Architect

Summary: 1. Key technical requirements and skills: - Expertise in designing and evolving scalable, cloud-native data architectures for advanced analytics and AI - Proficiency in Python for data processing and scripting - Hands-on experience with Apache Airflow, Google BigQuery, VectorDB, and cloud services (AWS, GCP) - Experience integrating with OneDrive 2. Team/project information: - The role is part of a global data platform modernization project for a world-leading media and information services company - The project involves developing a scalable, cloud-native data platform to support advanced analytics, AI/ML applications, and real-time/batch data processing 3. Unique or notable aspects: - The opportunity to shape next-generation global data infrastructure and work with cutting-edge AI/ML and streaming technologies - Exposure to both AWS an

• Design and evolve scalable, cloud-native data architectures for advanced analytics and AI
• Develop and maintain real-time and batch data processing platforms
• Define and implement data modeling standards for structured/unstructured data
• Integrate innovative technologies (vector databases, LLMs, real-time streaming)
• Ensure data quality, lineage, and governance
• Collaborate with engineering/product teams to translate business needs into solutions
• Optimize platform scalability, cost, and performance in cloud environments
• Establish architectural standards for data-driven decision-making

• 5+ years of experience in data architecture and engineering
• Proficiency in Python for data processing/scripting
• Hands-on experience with Apache Airflow
• Experience with n8n low-code workflow automation
• Strong knowledge of Google BigQuery
• Familiarity with VectorDB or similar
• Expertise in AWS or GCP cloud services
• Experience integrating with OneDrive
• Upper-Intermediate English proficiency

WILL BE A PLUS

• Experience with data governance tools (e.g., Collibra, Alation)
• Knowledge of streaming platforms like Apache Kafka
• AI/ML model deployment experience
• Multi-cloud architecture expertise
• Background in large-scale enterprise data migrations

PERSONAL PROFILE

• Analytical and strategic thinker with a passion for data innovation
• Strong communication and stakeholder management skills
• Proactive in exploring and adopting emerging technologies
• Collaborative team player with a global mindset

Are you ready to architect the future of global data platforms?
Sigma Software is looking for a Big Data Architect to join our team on a full-time, remote basis. You will work on a high-impact modernization project for a world-leading media and information services company, shaping the backbone of advanced analytics and AI initiatives.

This is your chance to design scalable, cloud-native architectures that power millions of professionals worldwide. Why join us? You’ll be part of a global project with cutting-edge technologies, influence key architectural standards, and collaborate with top-tier experts in a truly innovative environment.

CUSTOMER
Our customer is a global leader in providing trusted content, technology, and expertise to professionals across law, tax, compliance, government, and media sectors. With over 100 years of history and operations in more than 100 countries, they are recognized for their innovation in integrating AI and analytics into professional tools, and consistently rank among the most trusted sources for news and data.

PROJECT
You will contribute to the Global Data Platform Modernization project, developing a scalable, cloud-native data platform that supports advanced analytics, AI/ML applications, and real-time/batch data processing. This initiative offers you the opportunity to shape next-generation global data infrastructure, work with cutting-edge AI/ML and streaming technologies, and gain exposure to both AWS and GCP ecosystems.

Key Technologies: Python, Apache Airflow, n8n, Google BigQuery, VectorDB, AWS (S3, Lambda, Glue, Redshift), GCP (Cloud Storage, Dataflow, BigQuery), OneDrive integration

Originally posted on Himalayas