Senior Data Engineer with Exp in Snowflake & Amazon QuickSight(5+ Years of Exp)

At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective Industries. if your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐

Key Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines for enterprise data platforms
• Build and maintain robust data solutions using Snowflake, Python, and AWS services
• Develop advanced SQL queries using CTEs, window functions, query tuning, and performance optimization techniques
• Work with Snowflake warehouses, tasks, streams, and data pipelines for efficient data processing
• Create and maintain data transformation workflows using dbt (data build tool)
• Develop reporting datasets and support dashboarding solutions using Amazon QuickSight
• Perform data validation, data integrity checks, and root cause analysis to ensure data accuracy and reliability
• Integrate and manage data across platforms including DynamoDB, S3, AWS Glue, Lambda, and Rockset
• Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements
• Monitor pipeline performance and troubleshoot production data issues

Required Skills

• Strong experience in SQL including:
  • CTEs
  • Window Functions
  • Query Optimization
  • Performance Tuning
  • Hands-on experience with Snowflake:
    • Warehouses
    • Streams
    • Tasks
    • Data Loading and Optimization
    • Experience in Python for data processing and pipeline development
    • Experience with AWS services:
      • AWS Glue
      • Lambda
      • S3
      • Good knowledge of dbt (Data Build Tool)
      • Experience in creating dashboards and reports using Amazon QuickSight
      • Knowledge of Rockset analytical engine
      • Experience with DynamoDB and NoSQL databases
      • Basic to intermediate knowledge of JavaScript

Regards

Rajan Paul(Linkedin Profile)

3Pillar Global

Originally posted on Himalayas