Data Engineer Job at Soft source inc, Houston, TX

SUJ3dDlZckttdHZnRUdDckhVeWFPaXZ3Wmc9PQ==
  • Soft source inc
  • Houston, TX

Job Description

Key Responsibilities:
  • Design and maintain robust, secure, and high-performance data pipelines to support DAISY's processing and analytics workflows

  • Implement authentication and authorization mechanisms to secure data access and movement

  • Work with both SQL and NoSQL databases to store and retrieve structured and unstructured data efficiently

  • Apply data caching and optimization strategies to improve application responsiveness and system performance

  • Build, deploy, and manage containerized applications using Docker

  • Collaborate with developers, architects, and security teams to ensure system compliance and performance

  • Troubleshoot pipeline and infrastructure issues in development and production environments

  • Contribute to architecture discussions and make recommendations for technology direction

Required Qualifications:
  • 5+ years of experience in data engineering or backend data development

  • Strong hands-on experience in building data pipelines (ETL/ELT) for high-volume systems

  • In-depth knowledge of data security , authentication , and authorization strategies

  • Experience with SQL databases (e.g., PostgreSQL, SQL Server) and NoSQL databases (e.g., MongoDB, Redis)

  • Experience with caching strategies (e.g., Redis, Memcached)

  • Proficient in Docker building, managing, and deploying containers

  • Familiarity with data processing frameworks (e.g., Apache Kafka, Spark) is a plus

  • Experience with CI/CD tools and version control (e.g., Git/GitHub)

Preferred Qualifications:
  • Experience with Kubernetes for orchestration of containerized workloads

  • Background working on internal enterprise platforms or workflow systems

  • Knowledge of data governance, encryption, and compliance best practices

  • Strong scripting skills in Python , Bash , or similar

  • Experience in the Oil & Gas industry is a plus

Job Tags

Similar Jobs

Savage Development Inc

Site Monitor Job at Savage Development Inc

Savage Development Inc is currently looking to add to our team for 24/7 construction site monitoring. Positions starting as part-time with future potential for full-time positions, shifts are 12 hours (either 6:00 am - 6:00 pm or 6:00 pm to 6:00 am). Training, equipment... 

Delight TB Indiana Management LLC

Summer Associate Job at Delight TB Indiana Management LLC

 ...Summary Delight Restaurant Group is seeking a motivated and detail-oriented Summer Associate to join our team for Summer 2025. This internship is an exciting opportunity for a current college student to gain real-world experience by contributing to strategic financial... 

CTG

React Native Developer Job at CTG

**CTG is seeking to fill a React Native Developer opening for our client in Rochester, MN.****Location:** Remote**Duration:** 6 months**Duties:**+ Design, develop, and maintain mobile applications using React Native for both iOS and Android platforms.+ Collaborate... 

ABC Owned TV Stations

WABC ENG Photographer-Camera Operator Job at ABC Owned TV Stations

 ...New Yorks No. 1 station and the most-watched television station in the nation. WABC-TVs Weekend ENG Photographer / Camera Operator will work closely with the Assignment Desk, News Reporters and Managers to ensure the timely production of newscasts and special projects... 

Senior Benefits Agency

Insurance Sales Agent Job at Senior Benefits Agency

 ...Job Description: As a Medicare Sales Agent, you'll play a pivotal role in guiding clients...  .... Requirements Valid health insurance license (or willingness to obtain license...  ...industry, particularly in selling life insurance products. Strong knowledge...