Orrbasystems is an Information Technology Consulting and Staffing Firm. Over the course of years Orrbasystems has established itself as one of the premiere firms providing services to banking, financial, entertainment and insurance clients, among other industries.


  • 775 Addison Avenue, Suite   #202, Rock Hill, SC 29730
  • info@orrbasystems.com
  • +1(704) 733-8058

Big Data Engineer

  • May 12th, 2023
  • No Of Openings: 5
  • Full Time40 hours per week
  • Orrba Systems, LLC 775 Addison Avenue, Suite # 202 Rock Hill, SC 29730

Job Description

Work as part of the Big Data Engineering team which is responsible for transforming data into useful information for the data science team and product team. Working with Linux systems and Hadoop databases to extract data from Hadoop database and ingested using Scoop. Staging the real time data from gateway into AWS S3 or Azure Blob storage. Analyzing data using SQL Queries and transforming data into various stages such as preprocessed, standardized and filtered. Implementing Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data. Responsible to Use partitions in Spark session to improve the performance of the load time. Creating Pipelines in ADF using Linked Services/Datasets /Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards. Responsible for importing data and develop Spark streaming pipeline in Java Work under supervision. Travel And/or Relocation to unanticipated client sites is required.

Education Required

Master's degree in Computer Science/IT/IS/Engineering (Any) or closely related field.

Experience Required

See the job description.

Job Benifits

Standard Company Benefits.

Send resume by mail: HR Orrba Systems, LLC 775 Addison Avenue, Suite # 202, Rock Hill, SC 29730