AWS Glue Developing ETL pipelines, working with Glue Catalog, and transforming data using PySpark
AWS Lambda Writing serverless functions (Python, Node.js) to process, move, or transform data
AWS S3 Managing storage, organizing Qualtrics input/output files, and optimizing data retrieval
AWS Step Functions Orchestrating Glue and Lambda jobs into automated workflows
AWS Athena Querying structured data stored in S3 for quick analysis
AWS CloudWatch & Logging Monitoring job execution and debugging errors
AWS MWAA airflow for Jobs orchestration
2. Data Processing & ETL Skills
Data Transformation & Aggregation Merging dealer master and dealer employee files into a single hierarchy file
ETL Workflow Automation Automating ingestion, transformation, and report generation
Data Format Handling Processing CSV, JSON, or XML files from Qualtrics
3. API & Integration Skills
Qualtrics API Extracting raw data, managing survey responses, and automating data pull
AWS Event-Driven Processing Triggering Lambda jobs based on new files arriving in S3
Integration with External Systems Connecting AWS with CRM, ERP, or BI tools
4. Data Analysis & Reporting
Data Validation & Quality Checks Ensuring accuracy in processed files before Qualtrics ingests them Report File Generation Formatting data outputs as per business-defined templates
Basic SQL & Athena Queries Extracting insights from processed data
5. Programming & Scripting
Python Writing data processing scripts for Lambda, Glue (PySpark), and automation
SQL Querying and managing structured datasets
Shell Scripting (Bash) Automating file movement and data preparation
6. DevOps & Security (Nice to Have)
IAM Permissions & Role Management Ensuring AWS services have correct access
Infrastructure as Code (IaC) Using Terraform or CloudFormation for AWS resource setup
CI/CD for Data Pipelines Automating deployment of Lambda and Glue scripts
Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.
...POSITION SUMMARY : The Off-Shift Nurse Manager is a professional nurse who functions... ...and other resources during off-shifts, weekends and holidays. Position: Off Shift Supervisor... ...Accounts, 403(b) savings matches, paid time off, career advancement opportunities, and...
...supporting warehouse operations at Redbull's "Lagerhaus" location in Phoenix. Their responsibilities will include ensuring high data quality and governance across data systems and processes specific to Lagerhaus operations. This role involves developing, maintaining, and...
...Description Job Title: Retail Warehouse & Production Associate Who We Are As one of the largest for-profit thrift operators in the United States, Canada and Australia for value priced pre-owned clothing, accessories and household goods, our mission is to champion...
...We are seeking a Scientist / Sr. Scientist to join the Protein Science team at our Menlo Park HQ. As a member of the Protein Science... ..., efficient time management, excellent organizational and communication skills, and a passion for science. The role is laboratory-based...
...Title: Data Governance Analyst Location: Chicago, IL & Denver, CO (Onsite) Work Type: W2 Duration: Long Term Experienced Data Governance Analyst to support enterprise data governance initiatives within a financial institution. The role focuses on metadata...