ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING
The history of the development of experiment managemant systems has about 25 years – from small prototype desktop applications to scalable distributed systems. EMS systems are becoming more popular and more complex. A new stage in the development of EMS systems was the beginning of the «era of big d...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Tomsk Polytechnic University
2023-03-01
|
| Series: | Известия Томского политехнического университета: Промышленная кибернетика |
| Subjects: | |
| Online Access: | https://indcyb.ru/journal/article/view/6/4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | The history of the development of experiment managemant systems has about 25 years – from small prototype desktop applications to scalable distributed systems. EMS systems are becoming more popular and more complex. A new stage in the development of EMS systems was the beginning of the «era of big data», which processing, analysis and storage take place in a special ecosystem. The big data ecosystem implies new elements that must be taken into account when designing an EMS system to support the full data lifecycle. One of the key challenges is to generalize those EMS systems that have arisen and changed as related technologies have developed, while, at the moment, there is no single design pattern for such systems due to the features of each specific project for which such a system is created. This paper presents a conceptual high-level architecture of an EMS system as an example of a unified pattern suitable for a big data ecosystem. It is important to note that the proposed pattern does not imply work using grid systems. |
|---|---|
| ISSN: | 2949-5407 |