Skip to content

Latest commit

 

History

History
40 lines (38 loc) · 2.33 KB

README.md

File metadata and controls

40 lines (38 loc) · 2.33 KB

DavidREU2020

David's REU 2020 Project Code

Descriptions of Code Files

  • 1 queue 1 server simulation
    • Simulates based on a customizable average arrival rate
    • Outputs a normalized histogram of steady-state queue sizes
    • Can perform exponential curve fitting
  • 2 × 2 switch
    • Simulates based on a customizable threshold and four customizable average arrival rates
    • Outputs an (non-steady-state) average total queue length
    • Contains the random and MaxWeight policies
  • 3 queues 1 server simulation
    • Simulates based on three customizable average arrival rates
    • Outputs steady-state average queue lengths and normalized histograms of them
    • Contains the random, serve-the-shortest-queue, and serve-the-longest-queue policies
    • Contains the state-space-collapse phenomenon
  • 3 × 3 switch
    • Simulates based on nine customizable average arrival rates
    • Outputs nine (non-steady-state) average queue lengths
    • Contains the random and MaxWeight policies
  • 3-queue system in a 2 × 2 switch
    • Simulates based on three customizable average arrival rates
    • Outputs steady-state average queue lengths
    • Contains the MaxWeight, MaxSizeCenter, and random policies
    • Contains the state-space-collapse phenomenon
  • TD control for 3-queue system in a 2 × 2 switch
    • Simulates based on a customizable threshold and three customizable average arrival rates
    • Outputs steady-state average total queue lengths and simulation-parameter plots
    • Contains the random, MaxWeight, MaxSizeCenter, greedy, epsilon-greedy, epsion-MaxWeight, and epsilon-MaxSizeCenter policies
    • Contains the differential q-learning, relative-value-iteration q-learning, discounted-cost q-learning, average-cost q-learning, and average-cost Sarsa methods
  • comparison of performances for 3-queue system in a 2 × 2 switch
    • Simulates based on a customizable threshold, three customizable average arrival rates, and customizable simulation parameters
    • Outputs steady-state average total queue lengths and comparison-of-performances bar graphs
    • Contains outputs for thresholds 1, 2, 3, 4, and 8
  • state-value estimation for 3-queue system in a 2 × 2 switch
    • Simulates based on a customizable threshold and three customizable average arrival rates
    • Outputs state-value estimates
    • Contains the MaxWeight and MaxSizeCenter polices