Difference between revisions of "Private:progress-hegazy"

From NMSL
Line 1: Line 1:
 +
 +
==Sep 24-28==
 +
 +
===PCIe Project===
 +
* '''Accomplished''' (this week)
 +
** I registered the paper abstract in IPDPS.
 +
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.
 +
** Ahmed's code now works with most TCP clients and servers.
 +
* '''Issues'''
 +
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.
 +
* '''Next Steps'''
 +
** We will finish as much experiments as we can Friday and Saturday.
 +
** I should have the paper (almost) ready Saturday night.
 +
===HPC Storage===
 +
* '''Accomplished''' (this week)
 +
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark
 +
** We ran the partial autocorrelation function on it to get the Markov order.
 +
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.
 +
* '''Issues'''
 +
** Progress is a bit slow, but not too bad.
 +
* '''Next Steps'''
 +
** Abdullah is to get more logs from other real HPC applications
 +
** I will continue to define the Markov Decision Process.
 +
===Industrial Automation as a Service===
 +
* '''Accomplished''' (this week)
 +
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.
 +
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.
 +
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.
 +
* '''Issues'''
 +
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.
 +
* '''Next Steps'''
 +
** Ahmed should come up with the results soon.
 +
** More experiments (this time, on random delay) are to be conducted.
 +
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).
 +
 
==Sep 17-21==
 
==Sep 17-21==
 
===PCIe Project===
 
===PCIe Project===
Line 35: Line 70:
 
** Ahmed will try to accomplish the tasks rolled over from this week.
 
** Ahmed will try to accomplish the tasks rolled over from this week.
 
** I will have conference call with Ali to explain to him the next steps.
 
** I will have conference call with Ali to explain to him the next steps.
 
 
==Sep 24-28==
 
===PCIe Project===
 
* '''Accomplished''' (this week)
 
** I registered the paper abstract in IPDPS.
 
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.
 
** Ahmed's code now works with most TCP clients and servers.
 
* '''Issues'''
 
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.
 
* '''Next Steps'''
 
** We will finish as much experiments as we can Friday and Saturday.
 
** I should have the paper (almost) ready Saturday night.
 
===HPC Storage===
 
* '''Accomplished''' (this week)
 
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark
 
** We ran the partial autocorrelation function on it to get the Markov order.
 
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.
 
* '''Issues'''
 
** Progress is a bit slow, but not too bad.
 
* '''Next Steps'''
 
** Abdullah is to get more logs from other real HPC applications
 
** I will continue to define the Markov Decision Process.
 
===Industrial Automation as a Service===
 
* '''Accomplished''' (this week)
 
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.
 
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.
 
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.
 
* '''Issues'''
 
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.
 
* '''Next Steps'''
 
** Ahmed should come up with the results soon.
 
** More experiments (this time, on random delay) are to be conducted.
 
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).
 

Revision as of 23:12, 2 October 2012

Sep 24-28

PCIe Project

  • Accomplished (this week)
    • I registered the paper abstract in IPDPS.
    • I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.
    • Ahmed's code now works with most TCP clients and servers.
  • Issues
    • We are running the experiments now (Friday night) and time is tight for the IPDPS submission.
  • Next Steps
    • We will finish as much experiments as we can Friday and Saturday.
    • I should have the paper (almost) ready Saturday night.

HPC Storage

  • Accomplished (this week)
    • I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark
    • We ran the partial autocorrelation function on it to get the Markov order.
    • I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.
  • Issues
    • Progress is a bit slow, but not too bad.
  • Next Steps
    • Abdullah is to get more logs from other real HPC applications
    • I will continue to define the Markov Decision Process.

Industrial Automation as a Service

  • Accomplished (this week)
    • I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.
    • Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.
    • I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.
  • Issues
    • Progress is a bit too slow; we could have easily obtained results this week, but we didn't.
  • Next Steps
    • Ahmed should come up with the results soon.
    • More experiments (this time, on random delay) are to be conducted.
    • Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).

Sep 17-21

PCIe Project

  • Accomplished (this week)
    • Ahmed bought and successfully installed the Infiniband cards.
    • Benchmark experiments were run for Infiniband.
  • Issues
    • Ahmed's implementation of SDP doesn't support asynchronous calls.
    • Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP)
    • Time is tight for the IPDPS submission.
  • Next Steps
    • Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.
    • I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th).
    • Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.

HPC Storage

  • Accomplished (this week)
    • Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.
    • During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB).
  • Issues
    • None
  • Next Steps
    • Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).
    • I will go into one more level of details for the general methodology.

Industrial Automation as a Service

  • Accomplished (this week)
    • I have come up with the delay compensation results and updated the working document.
    • I have met with Ahmed AbdelSadek and explained the problem and experiments to him.
    • Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.
  • Issues
    • Ahmed had was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".
    • Communication rate with Ali is a bit slow.
  • Next Steps
    • I may have to work on the delay experiments myself until Ahmed is up to speed.
    • Ahmed will try to accomplish the tasks rolled over from this week.
    • I will have conference call with Ali to explain to him the next steps.