Survey of Scientific Programming Techniques for the Management of Data-Intensive Engineering Environments Articles uri icon

publication date

  • January 2018

International Standard Serial Number (ISSN)

  • 1058-9244

Electronic International Standard Serial Number (EISSN)

  • 1875-919X

abstract

  • The present paper introduces and reviews existing technology and research works in the field of scientific programming methods and techniques in data-intensive engineering environments. More specifically, this survey aims to collect those relevant approaches that have faced the challenge of delivering more advanced and intelligent methods taking advantage of the existing large datasets. Although existing tools and techniques have demonstrated their ability to manage complex engineering processes for the development and operation of safety-critical systems, there is an emerging need to know how existing computational science methods will behave to manage large amounts of data. That is why, authors review both existing open issues in the context of engineering with special focus on scientific programming techniques and hybrid approaches. 1193 journal papers have been found as the representative in these areas screening 935 to finally make a full review of 122. Afterwards, a comprehensive mapping between techniques and engineering and nonengineering domains has been conducted to classify and perform a meta-analysis of the current state of the art. As the main result of this work, a set of 10 challenges for future data-intensive engineering environments have been outlined.

keywords

  • artificial neural-networks; graphics-processing-unit; big-data; linear algebra; gpu clusters; optimization; systems; model; simulation; time