Python-based social science applications’ profiling and optimization on HPC systems using task and data parallelism
Downloads
Published
DOI:
https://doi.org/10.58414/SCIENTIFICTEMPER.2023.14.3.48Keywords:
Python-based social science applications, High-performance computing systems, task and data parallelism, Optimization methodology, Machine learning model evaluationDimensions Badge
Issue
Section
License
Copyright (c) 2023 The Scientific Temper
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This research addresses the pressing need to optimize Python-based social science applications for high-performance computing (HPC)Abstract
systems, emphasizing the combined use of task and data parallelism techniques. The paper delves into a substantial body of research,
recognizing Python’s interpreted nature as a challenge for efficient social science data processing. The paper introduces a Python
program that exemplifies the proposed methodology. This program uses task parallelism with multi-processing and data parallelism
with dask to optimize data processing workflows. It showcases how researchers can effectively manage large datasets and intricate
computations on HPC systems. The research offers a comprehensive framework for optimizing Python-based social science applications
on HPC systems. It addresses the challenges of Python’s performance limitations, data-intensive processing, and memory efficiency.
Incorporating insights from a rich literature survey, it equips researchers with valuable tools and strategies for enhancing the efficiency
of their social science applications in HPC environments.
How to Cite
Downloads
Similar Articles
- Rajeev P. R., K. Aravinthan, A novel approach for metrics-based software defect prediction using genetic algorithm , The Scientific Temper: Vol. 15 No. 03 (2024): The Scientific Temper
- Hemamalini V., Victoria Priscilla C, Deep learning driven image steganalysis approach with the impact of dilation rate using DDS_SE-net on diverse datasets , The Scientific Temper: Vol. 15 No. 04 (2024): The Scientific Temper
- A. Anand, A. Nisha Jebaseeli, A comparative analysis of virtual machines and containers using queuing models , The Scientific Temper: Vol. 15 No. spl-1 (2024): The Scientific Temper
- M. Rajalakshmi, V. Sulochana, Enhancing deep learning model performance in air quality classification through probabilistic hyperparameter tuning with tree-structured Parzen estimators , The Scientific Temper: Vol. 14 No. 04 (2023): The Scientific Temper
- Rama Rao J.V.G, Raja Gopal A.N.V.J, Ponnaganti S. Prasad, Illa V. Ram, Muthuvel B, Power quality improvement in BLDC motor drive using PFC converter , The Scientific Temper: Vol. 14 No. 04 (2023): The Scientific Temper
- Muhammed Jouhar K. K., Dr. K. Aravinthan, An improved social media behavioral analysis using deep learning techniques , The Scientific Temper: Vol. 15 No. 03 (2024): The Scientific Temper
- T. Kanimozhi, V. Rajeswari, R. Suguna, J. Nirmaladevi, P. Prema, B. Janani, R. Gomathi, RWHO: A hybrid of CNN architecture and optimization algorithm to predict basal cell carcinoma skin cancer in dermoscopic images , The Scientific Temper: Vol. 15 No. 02 (2024): The Scientific Temper
- Sowmiya M, Banu Rekha B, Malar E, Ensemble classifiers with hybrid feature selection approach for diagnosis of coronary artery disease , The Scientific Temper: Vol. 14 No. 03 (2023): The Scientific Temper
- R. Kalaiselvi, P. Meenakshi Sundaram, Machine learning-based ERA model for detecting Sybil attacks on mobile ad hoc networks , The Scientific Temper: Vol. 15 No. 04 (2024): The Scientific Temper
- Pravin P. P, J. Arunshankar, Development of digital twin for PMDC motor control loop , The Scientific Temper: Vol. 14 No. 01 (2023): The Scientific Temper
<< < 8 9 10 11 12 13 14 15 16 17 > >>
You may also start an advanced similarity search for this article.
