AWS Data Engineer Job at Pi-Square Technologies LLC, Torrance, CA

NW9mYWs0cUFCcnZaZ1FCTnJ4U2NMbkhw
  • Pi-Square Technologies LLC
  • Torrance, CA

Job Description

AWS Glue Developing ETL pipelines, working with Glue Catalog, and transforming data using PySpark

AWS Lambda Writing serverless functions (Python, Node.js) to process, move, or transform data

AWS S3 Managing storage, organizing Qualtrics input/output files, and optimizing data retrieval

AWS Step Functions Orchestrating Glue and Lambda jobs into automated workflows

AWS Athena Querying structured data stored in S3 for quick analysis

AWS CloudWatch & Logging Monitoring job execution and debugging errors

AWS MWAA airflow for Jobs orchestration

2. Data Processing & ETL Skills

Data Transformation & Aggregation Merging dealer master and dealer employee files into a single hierarchy file

ETL Workflow Automation Automating ingestion, transformation, and report generation

Data Format Handling Processing CSV, JSON, or XML files from Qualtrics

3. API & Integration Skills

Qualtrics API Extracting raw data, managing survey responses, and automating data pull

AWS Event-Driven Processing Triggering Lambda jobs based on new files arriving in S3

Integration with External Systems Connecting AWS with CRM, ERP, or BI tools

4. Data Analysis & Reporting

Data Validation & Quality Checks Ensuring accuracy in processed files before Qualtrics ingests them Report File Generation Formatting data outputs as per business-defined templates

Basic SQL & Athena Queries Extracting insights from processed data

5. Programming & Scripting

Python Writing data processing scripts for Lambda, Glue (PySpark), and automation

SQL Querying and managing structured datasets

Shell Scripting (Bash) Automating file movement and data preparation

6. DevOps & Security (Nice to Have)

IAM Permissions & Role Management Ensuring AWS services have correct access

Infrastructure as Code (IaC) Using Terraform or CloudFormation for AWS resource setup

CI/CD for Data Pipelines Automating deployment of Lambda and Glue scripts

Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.

Job Tags

Full time, Contract work,

Similar Jobs

Acara Solutions

Part-time Marketing Specialist Job at Acara Solutions

 ...Acara Solutions is seeking a Part-Time Marketing Specialist to work with our client Headquartered in Boston, MA. This position is 100% remote. Pay:$25.00/hour Schedule: Part-time (20 hours per week, flexible schedule) Job Type:6-month contract Overview... 

Brandcoven

Marketing Assistant Job at Brandcoven

 ...Job Title: Marketing Assistant Location: Remote, United States Company Overview: Brandcoven is a leading marketing agency...  ...United States. Contract Details: This is a full-time or part-time position, depending on your availability and the needs... 

Home Work Staffing

Live-in Rotational Nanny (2 Weeks Per Month) in Oklahoma City, OK Job at Home Work Staffing

 ...Live-in Rotational Nanny (2 Weeks Per Month) in Oklahoma City, OK Live-In Rotational Nanny needed for a busy family of dual physicians with two children ages 3 and 7 years old. Looking for someone who can come 2 weeks per month, scheduled will be given 1 month in advance... 

Advanced Suspension Design

Marketing Coordinator Job at Advanced Suspension Design

 ...modifications. From daily drivers to off-road rigs and race cars, we serve a diverse and passionate customer base. We are looking for a part time Marketing Coordinator who is passionate about cars, trucks, off-road builds, racing, and wants hands-on marketing experience in the... 

Brother International Corporation

Data Governance Intern (Summer 2026 Internship Program) Job at Brother International Corporation

 ...this summer, dependent on business need and priorities. Define and document critical business terms and metadata within a new data governance platform to support a shared understanding across teams Design and pilot the initial training curriculum to drive user...