Skip to content
Snippets Groups Projects

Compare revisions

Changes are shown as if the source revision was being merged into the target revision. Learn more about comparing revisions.

Source

Select target project
No results found

Target

Select target project
  • chirag24/createandparsesacct
  • rrand11/createandparsesacct
  • jpr/createandparsesacct
  • bkomal96/createandparsesacct
  • atlurie/createandparsesacct
5 results
Show changes
Commits on Source (59)
[submodule "RC_styles**"]
path = RC_styles**
[submodule "RC_styles"]
path = RC_styles
url = https://gitlab.rc.uab.edu/bkomal96/rc_styles.git
This diff is collapsed.
Subproject commit 7a2fd65482b64345b1cd923f38846433f7c33399
# Release notes version - 1.0 (12/08/2020)
# Cluster Analysis
This initial version creates the dataset, kmeans clustering, and resulting graphs to analize how our users are utilizing the cluster.
Features included:
- User input to choose date range of data to analyze
- User input to choose min and max values for ReqMemCPU, AllocCPUS, and Elapsed
- User input to choose how data is normalized: 0-1, log, or no normalization
- User input to choose min and max x and y axes for 2D histogram graphs
# Next Release Planned Features (coming December 2020)
- data on job counts for each density spot in 2d histograms
- summary statistics for each cluster in the form of the count of jobs and the count of users per cluster
# Release Notes version - 1.1 Bug Fix (12/15/2020)
Dataset for completed jobs orginally had all jobs and each of their job steps. This skewed the clustering graphs, as there were more data points than individual jobs ran. The data is now being pulled into the dataset using only allocated jobs (done with -X in the slurm2sql.slurm2sql command), which results in each row of the dataset being a different job.
# Release Notes verion - 2.0 (12/22/2020)
Added summary stats for each cluster. This includes the count for both jobs ran and users running those jobs for each of the four clusters.
- summary statistics in the form of a table showing the job and user count for each cluster
* Data on stats for each density spot in the 2d histograms will come in another notebook. This notebook will be a deeper analysis of each 2d histogram for each cluster. This notebook should be released by end of January 2021.
*.ipynb filter=nbstrip_full
[core]
attributesfile = ~/.gitattributes
[filter "nbstrip_full"]
clean = "jq --indent 1 \
'(.cells[] | select(has(\"outputs\")) | .outputs) = [] \
| (.cells[] | select(has(\"execution_count\")) | .execution_count) = null \
| .metadata = {\"language_info\": {\"name\": \"python\", \"pygments_lexer\": \"ipython3\"}} \
| .cells[].metadata = {} \
'"
smudge = cat
required = true
[submodule "RC_styles"]
path = RC_styles
url = https://gitlab.rc.uab.edu/bkomal96/rc_styles.git
......@@ -48,7 +48,7 @@ parso==0.6.2
pexpect==4.8.0
phik==0.9.9
pickleshare==0.7.5
plotly==4.5.2
plotly==4.8.2
pluggy==0.13.1
prometheus-client==0.7.1
prompt-toolkit==3.0.3
......
This diff is collapsed.