발간년도 : [2021]
논문정보 |
|
논문명(한글) |
[Vol.16, No.3] Dynamic Resource Optimization System for High-speed Data Transfer |
|
논문투고자 |
Se-young Yu |
|
논문내용 |
Big data science collaboration enables science research to discover deeper knowledge of technology human behavior and the universe. To better utilize the big data for science collaboration we need to enable efficient data sharing between remote sites that generate scientific data and analyze it. There have been numerous studies on optimizing data sharing in modern research infrastructure using high-speed networks and DTNs. However, the optimization has been limited to heuristics and manual optimization to find suitable configurations for specific collaboration environments due to a large configuration space and heterogeneous set of hardwares, softwares, and network connections. We present a dynamic optimization system for DTNs that can explore available configuration space in specific environments and automatically adjust to the dynamic environment. We build a next-generation data transfer system that can monitor existing data transfer and use various techniques to find out available resources in the system and tries to utilize them. Our focus in this research is to provide an environment for the infrastructure administrator to examine their existing infrastructure and find an optimal configuration for each environment without minimal human intervention. Our system can find optimal storage configuration and apply transfer parameters in the DTNs in a science infrastructure in real-time to maximize available resources. |
|
첨부논문 |
|
|
|
|
|