Open Data Science job portal

Spark Big Data Engineer 992 views

They Are:

Applied Intelligence, the people who love using data to tell a story. They’re also the world’s largest team of data scientists, data engineers, and experts in machine learning and AI. A great day for them? Solving big problems using the latest tech, serious brainpower, and deep knowledge of just about every industry. They believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join their crew of sharp analytical minds? Visit them here to find out more about Applied Intelligence.

You Are:

A Spark Big Data engineering pro—someone who thrives in a team setting where you can use your creative and analytical prowess to obliterate problems. You’re passionate about digital technology, and you take pride in making a tangible difference. You have communication and people skills in spades, along with strong leadership chops. Complex issues don’t faze you thanks to your razor-sharp critical thinking skills. Working in an information systems environment makes you more than happy.

The Work:

    • Consult as part of a team that’s in charge of building end-to-end digital transformation capabilities, and lead fast-moving development teams using Agile methodologies.
    • Design and build Big Data and real-time analytics solutions using industry-standard technologies, and work with data architects to make sure Big Data solutions align with technology direction.
    • Lead by example, role-modeling best practices for unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response.
    • Keep everyone from individual contributors to top executives in the loop about progress, communicating across organizations and levels. If critical issues block progress, refer them up the chain of command to be resolved in a timely manner. Optimize NLU model by implementing NLP systems, performing intent classification and entity extraction, and user testing Develop and maintain digital conversational flows, dialog Research, Architect, Prototype, and Test Dialogue Management system and Natural Language Generator Connect to a data source (e. g. multiple XML documents) and query database
    • Pinpoint and clarify key issues that need action, lead the response, and articulate results clearly in an actionable form.
    • Show a strong aptitude for carrying out solutions and translating objectives into a scalable solution that meets end customers’ needs within deadlines. Collaborate with research teams working on a variety of deep learning and NLP problems

Here’s What You Need:

      • A Bachelor’s degree in Computer Science, Engineering, or Technical Science, or 3 years’ experience programming and building large-scale data or analytics solutions operating in production environments
      • Minimum of 2 years’ experience designing and implementing large-scale data pipelines for data curation, feature engineering, and machine learning, using Spark in combination with PySpark, Java, Scala, or Python
      • Minimum of 1 year’s experience designing and building performant data tiers, or refactoring existing ones, that supports scaled AI and Analytics, using different Cloud-native data stores on AWS, Azure, and Google (such as Redshift, S3, Big Query, or SQLDW), as well as using NoSQL and Graph Stores
      • Minimum of 1 year’s experience designing and building streaming data ingestion, analysis, and processing pipelines using Kafka, Kafka Streams, Spark Streaming, and similar cloud-native technologies
      • Minimum of 1 year’s experience in performance engineering, profiling and debugging very large Big Data and machine learning production solutions on Spark and Cloud-native technologies

Bonus Points if:

        • You have experience designing and building secured and governed Big Data ETL pipelines, using Talend or Informatica technologies for data curation and analysis of large production deployed solutions[LC1]
        • You have experience designing and implementing large-scale data warehousing and analytics solutions working with RDBMS (such as Oracle, Teradata, DB2, Netezza, SAS), and grasping the challenges and limitations of these traditional solutions
        • You’ve got experience working with Databricks, SageMaker, and other Cloud-native tools
        • You’re familiar with implementing smart data preparation tools such as Palate, Trifacta, or Tamr for enhancing analytics solutions
        • You have experience building Business Data Catalogs or Data Marketplaces for powering business analytics using technologies such as Alation, Collibra, Informatica, or custom solutions

Accenture Overview

        • They are a global collective of innovators applying the New every day to improve the way the world works and lives. Help them show the world what’s possible as you partner with clients to unlock hidden value and deliver innovative solutions. Empowered with innovative tools, continuous learning and a global community of diverse talent and perspectives, they drive success in a new business architecture that disrupts conventional practices. Their expertise spans 40+ industries across 120+ countries and impacts millions of lives every day. They turn ideas into reality.

Important information

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Accenture.

Accenture is an EEO and Affirmative Action Employer of Females/Minorities/Veterans/Individuals with Disabilities.

Equal Employment Opportunity

All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.

Accenture is committed to providing veteran employment opportunities to their servicemen and women.

Candidates who are currently employed by a client of Accenture or an affiliated Accenture business may not be eligible for consideration.


More Information

Share this job
Company Information
  • Total Jobs 24 Jobs
  • Location Boston
Connect with us
Contact Us

Here at the Open Data Science Conference we gather the attendees, presenters, and companies that are working on shaping the present and future of AI and data science. ODSC hosts one of the largest gatherings of professional data scientists with major conferences in the USA, Europe, and Asia.

Contact Us