https://nmsl.cs.sfu.ca/api.php?action=feedcontributions&feedformat=atom&user=ThegazyNMSL - User contributions [en-ca]2026-04-11T09:23:15ZUser contributionsMediaWiki 1.35.1https://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5521cloudAutomation2013-07-17T21:05:09Z<p>Thegazy: </p>
<hr />
<div>===Industrial Automation as a Cloud Service===<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can Industrial Automation Benefit from Cloud Computing?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming Current Industrial Automation Systems into Cloud-Based Systems ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How We Test Our Approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of our fault tolerance algorithm under failures.</div><br />
<br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">The importance of the smooth handover (S.H.) feature in our fault tolerance algorithm</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5519cloudAutomation2013-07-17T20:58:32Z<p>Thegazy: </p>
<hr />
<div>===Industrial Automation as a Cloud Service===<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can Industrial Automation Benefit from Cloud Computing?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming Current Industrial Automation Systems into a Cloud-Based Systems ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How We Test Our Approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of our fault tolerance algorithm under failures.</div><br />
<br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">The importance of the smooth handover (S.H.) feature in our fault tolerance algorithm</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5518cloudAutomation2013-07-17T20:56:54Z<p>Thegazy: </p>
<hr />
<div>===Industrial Automation as a Cloud Service===<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of our fault tolerance algorithm under failures.</div><br />
<br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">The importance of the smooth handover (S.H.) feature in our fault tolerance algorithm</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5517cloudAutomation2013-07-17T20:56:42Z<p>Thegazy: </p>
<hr />
<div>==Industrial Automation as a Cloud Service==<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of our fault tolerance algorithm under failures.</div><br />
<br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">The importance of the smooth handover (S.H.) feature in our fault tolerance algorithm</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5516cloudAutomation2013-07-17T20:54:54Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of our fault tolerance algorithm under failures.</div><br />
<br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">The importance of the smooth handover (S.H.) feature in our fault tolerance algorithm</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5515cloudAutomation2013-07-17T20:53:32Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation11.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div><br />
<br />
[[Image:cloudAutomation12.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5514cloudAutomation2013-07-17T20:53:03Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
<br />
===Fault Tolerance===<br />
We developed a novel distributed fault tolerance approach that we call Reliable Cloud Control (RCC). The novelty mainly lies in (i) providing theoretical performance guarantees, (ii) eliminating the need of clock synchronization of VMs hosting redundant controllers, (iii) maintaining the control loop state at the process side, which makes it easily visible to cloud controllers, and (iv) handing over controllers in a smooth manner.<br />
<br />
<br />
[[Image:cloudAutomation04.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div><br />
<br />
[[Image:cloudAutomation04.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5513cloudAutomation2013-07-17T20:51:46Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
We place our controllers thousands of miles away from the controller process. In our experiments, we used two redundant controllers for each process. The primary controller runs on a VM on the Amazon Cloud in Singapore, and the secondary controller runs on the Amazon Cloud in Brazil. The physical model and the emulated plant are hosted in our lab.<br />
<br />
[[Image:cloudAutomation08.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Our cloud controllers located thousands of miles away from the industrial plant.</div><br />
<br />
<br />
===Delay Compensation===<br />
We algebraically map the roundtrip delay problem to the classic control-theoretic problem of controlling a process with dead-time. We design an adaptive delay compensator that proves to compensate for very large, variable communication delays.<br />
<br />
<br />
[[Image:cloudAutomation09.png|center|350px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Overview of the proposed controller that compensates for communication delays.</div><br />
<br />
<br />
[[Image:cloudAutomation10.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Performance of the proposed delay compensator (blue line) is very close to that of the no delay case (green line) for a process of 300 ms scan period under variable communication delay that follows a random distribution whose parameters are: mean = 4s, standard deviation: 2.8 s, maximum = 20 s. Note that without compensation the controlled process becomes unstable (dotted red line).</div><br />
<br />
[[Image:cloudAutomation04.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5512cloudAutomation2013-07-17T20:49:02Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation07.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5511cloudAutomation2013-07-17T20:48:30Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation07.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
[[Image:cloudAutomation04.png|center|100px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5510cloudAutomation2013-07-17T20:48:08Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation07.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5509cloudAutomation2013-07-17T20:47:48Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Physical model of the solar power plant.</div><br />
<br />
[[Image:cloudAutomation06.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">One of the commercial analog I/O modules with TCP/Ethernet capabilities used in our evaluation.</div><br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5508cloudAutomation2013-07-17T20:46:25Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
===How we test our approach? ===<br />
<br />
We use commercial (Amazon) cloud to host industrial controllers to control a physical model of a solar power plant hosted in our lab. We also use industry-standard emulation for testing under large disturbance.<br />
<br />
[[Image:cloudAutomation05.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Process diagram of the solar power plant.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;"></div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5507cloudAutomation2013-07-17T20:43:17Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.</div> <br />
<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Current industrial automation system architecture.</div><br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Proposed architecture for industrial automation as a service.</div><br />
<br />
<br />
<br />
<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Centered text</div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5506cloudAutomation2013-07-17T20:40:00Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
<div class="center" style="width: auto; margin-left: auto; margin-right: auto;">Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).</div> <br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
Current industrial automation system architecture.<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
Proposed architecture for industrial automation as a service.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5505cloudAutomation2013-07-17T20:38:52Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s<sub>E</sub>).<br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
Current industrial automation system architecture.<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
Proposed architecture for industrial automation as a service.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5504cloudAutomation2013-07-17T20:38:27Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (s<sub>L</sub>) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (sE).<br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
Current industrial automation system architecture.<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
Proposed architecture for industrial automation as a service.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5503cloudAutomation2013-07-17T20:37:02Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (sL) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (sE).<br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.<br />
<br />
[[Image:cloudAutomation03.png|center|400px]]<br />
Current industrial automation system architecture.<br />
<br />
[[Image:cloudAutomation04.png|center|500px]]<br />
Proposed architecture for industrial automation as a service.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5502cloudAutomation2013-07-17T20:35:30Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (s ,,L,,) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s ~E~).<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5501cloudAutomation2013-07-17T20:34:10Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
Total cost saving under proposed cloud-based automation system for different values of labor saving (s ~L~) ranging from 0.1 to 0.8.<br />
<br />
[[Image:cloudAutomation02.png|center|300px]]<br />
Total Time to Start Up (TTSU) saving under proposed cloud-based automation system for different values of engineering time saving (s ~E~).<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5500cloudAutomation2013-07-17T20:30:32Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
[[Image:cloudAutomation01.png|center|300px]]<br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation12.png&diff=5499File:cloudAutomation12.png2013-07-17T20:29:32Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation11.png&diff=5498File:cloudAutomation11.png2013-07-17T20:29:24Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation10.png&diff=5497File:cloudAutomation10.png2013-07-17T20:29:14Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation09.png&diff=5496File:cloudAutomation09.png2013-07-17T20:29:06Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation08.png&diff=5495File:cloudAutomation08.png2013-07-17T20:28:55Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation07.png&diff=5494File:cloudAutomation07.png2013-07-17T20:28:44Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation06.png&diff=5493File:cloudAutomation06.png2013-07-17T20:28:37Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation05.png&diff=5492File:cloudAutomation05.png2013-07-17T20:28:28Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation04.png&diff=5491File:cloudAutomation04.png2013-07-17T20:28:17Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation03.png&diff=5490File:cloudAutomation03.png2013-07-17T20:28:09Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation02.png&diff=5489File:cloudAutomation02.png2013-07-17T20:28:00Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=File:cloudAutomation01.png&diff=5488File:cloudAutomation01.png2013-07-17T20:27:41Z<p>Thegazy: </p>
<hr />
<div></div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5487cloudAutomation2013-07-17T19:49:07Z<p>Thegazy: </p>
<hr />
<div>====Introduction: Industrial Automation as a Cloud Service====<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.<br />
<br />
<br />
===Can industrial automation benefit from cloud computing to reduce costs and deployment time?===<br />
We develop simplified mathematical models to compute the savings in cost and time that would be achieved by the proposed system. We use a case study inspired by large real-life automation systems to evaluate the potential cost and time savings. Our study shows that the cloud-based automation approach can (i) save at least 43% of the total cost and up to 57% in some cases, and (ii) save 25-85% of the time needed to get the system ready to start up. Thus, our analysis confirms that success of the cloud computing model in other application domains can be extended to industrial automation.<br />
<br />
<br />
===Transforming current industrial automation architecture into a cloud-based architecture ===<br />
Current systems are expensive and take a long time to set up. On the other hand, our proposed architecture saves cost and time and simplifies the design of control rooms.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=cloudAutomation&diff=5486cloudAutomation2013-07-17T19:46:22Z<p>Thegazy: Created page with "===Industrial Automation as a Cloud Service=== Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A ..."</p>
<hr />
<div>===Industrial Automation as a Cloud Service===<br />
<br />
Current large-scale industrial automation systems are offered at a very high cost and take months or even years to start up. A large part of the development/engineering time and cost is due to the reliance on physical controllers. In this project, we<br />
* Answer the question: “Can industrial automation benefit from cloud computing to reduce costs and deployment time?” <br />
* Design an architecture for providing industrial automation as a cloud service.<br />
* Design a delay compensation method to mitigate roundtrip Internet delays.<br />
* Design a distributed fault tolerance approach to mitigate controller and link failures.<br />
* Evaluate our approach on commercial cloud using a physical model of a solar power plant hosted in our lab.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Network_and_Multimedia_Systems_Lab_(NMSL)&diff=5485Network and Multimedia Systems Lab (NMSL)2013-07-17T19:43:59Z<p>Thegazy: /* High Performance and Cloud Computing */</p>
<hr />
<div>__NOTOC__<br />
<br />
'''Welcome to the Network Systems Lab (NSL) at SFU!'''<br />
<br />
<br />
We are interested in the broad areas of computer networking and multimedia systems. We develop algorithms and protocols to enhance the performance of networks, especially the Internet, and to efficiently distribute multimedia content to large-scale user communities. The Network Systems Lab is led by [http://www.cs.sfu.ca/~mhefeeda/ Dr. Mohamed Hefeeda.] The NSL lab is located in room SUR 4150 (Surrey campus). <br />
<br />
<br />
We hold regular [[group meeting]] for discussion and brainstorming.<br />
<br />
<br />
Our current research interests include multimedia networking, mobile multimedia. and cloud computing. Brief description and links to currently active projects are given below. <br />
<br />
<br />
== '''Multimedia Networking''' == <br />
<br />
We are focusing on distributed streaming in dynamic environments and for heterogeneous clients. Our goal is to analyze and understand scalable coding techniques, and to design several optimization and streaming algorithms to make the best possible use of them in real multimedia systems. This will yield better quality for users, and more efficient utilization of network and server resources. We are also designing algorithms to optimize streaming quality for wireless and mobile clients. <br />
<br />
* '''[[Scalable Multimedia Streaming]]''' <br />
<br />
* '''[[mobileTV|Mobile TV Networks]]''' <br />
<br />
* '''[[wimax|Multimedia Streaming over WiMAX Networks]]'''<br />
<br />
<br />
== '''Peer-to-Peer Systems''' ==<br />
<br />
We are exploring the applicability of the P2P paradigm to build cost-effective content distribution systems. Problems such as sender selection, adaptive object replication, and content caching are being studied. We are also developing models to analyze the new characteristics of the P2P traffic and the impact of these characteristics on the cache replacement policies and object replication strategies. <br />
Furthermore, we are devising analytic models to study the dynamics of the P2P system capacity and the impact of various parameters on it. <br />
<br />
* '''[[pCDN|pCDN: Peer-assisted Content Distribution Network]]'''<br />
<br />
<br />
== '''Online Networked Games''' == <br />
<br />
We are designing various algorithms to improve the performance of online games. <br />
<br />
* '''[[Minimizing Round-Trip Time in Online Games]]'''<br />
<br />
* '''[[Minimizing Energy Consumption for Online Games on Mobile Phones]]'''<br />
<br />
<br />
== '''High Performance and Cloud Computing''' == <br />
<br />
We are exploring the opportunities of utilizing new architectures such as GPUs, multi-core processors, and distributed clusters (cloud computing) to efficiently solve research problems related to multimedia content analysis, <br />
large-scale data analysis, and machine learning techniques.<br />
<br />
* '''[[hpc|Approximation algorithms for Kernel Methods on Multi-core CPUs and GPUs]]'''<br />
<br />
* '''[[videoInfringement | Video Copy Detection using Cloud Computing]]'''<br />
<br />
* '''[[flash| Improving Performance of Data Centers using Flash Memory]]'''<br />
<br />
* '''[[cloudAutomation| Industrial Automation as a Cloud Service]]'''<br />
<br />
<br />
----<br />
<br />
<br />
----<br />
<br />
= '''''Concluded Projects''''' =<br />
<br />
<br />
<br />
<br />
== '''Wireless Sensor Networks''' == <br />
<br />
We are developing coverage and connectivity maintenance protocols that consider probabilistic (i.e., more realistic) sensing and communication models. We are also designing protocols that provide controllable degrees of coverage (k-coverage). <br />
<br />
* '''[[Probabilistic Coverage and Connectivity]]'''<br />
<br />
* '''[[K-Coverage and its Application to Forest Fire Detection]]'''<br />
<br />
<br />
== '''Network Security''' == <br />
<br />
We are exploring network monitoring techniques to detect and thwart intrusion and denial-of-service attacks in their early stages by observing unusual traffic patterns injected by such attacks. We are studying the security of multimedia streaming systems that employ multi-layer and fine-grain scalable video streams. <br />
<br />
* '''[[Security of the SIP protocol]]''' <br />
<br />
* '''[[Detecting DoS Attacks and Service Violations in QoS-enabled Networks]]'''<br />
<br />
* '''[[Security of Scalable Multimedia Streams]]'''<br />
<br />
<br />
== '''Online Advertising''' == <br />
Online advertising is a form of promotion that uses the Internet and World Wide Web for advertising a good or service to attract users. Examples of online advertising include contextual ads on search engine results pages,, banner ads, Rich Media Ads. <br />
<br />
* '''[[Predicting ads' quality ]]'''<br />
<br />
* '''[[Advertising in Online Videos ]]'''<br />
<br />
<br />
== '''P2P and Multimedia Systems''' == <br />
<br />
* '''[[Modeling and Caching of P2P Traffic]]'''<br />
<br />
* '''[[CanVid|CanVid: Content- and Network-aware Video Processing]]'''<br />
<br />
<br />
== '''Others''' == <br />
<br />
* '''[[tethering|Tethering in Cellular Data Networks ]]'''<br />
<br />
* '''[[esswn|Efficient and Secure Streaming of Scalable Multimedia Content over Wireless Networks]]'''</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Publications&diff=5473Publications2013-07-03T03:02:47Z<p>Thegazy: /* Technical Reports and Manuscripts Under Review */</p>
<hr />
<div>= Journals =<br />
<br />
'''2013'''<br />
<br />
* F. Tabrizi, J. Peters, and M. Hefeeda, '''Dynamic Control of Receiver Buffers in Mobile Video Streaming Systems''', ''IEEE Transactions on Mobile Computing'', 12(5), pp. 995--1008, May 2013.<br />
<br />
* N. Khodabakhshi and M. Hefeeda, '''Spider: A System for Finding 3D Video Copies''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 9(1), Article 7, pp. 1--20, February 2013.<br />
<br />
* K. Mokhtarian and M. Hefeeda, '''Capacity Management of Seed Servers in Peer-to-Peer Streaming Systems With Scalable Video Streams''', ''IEEE Transactions on Multimedia'', 15(1), pp. 181--194, January 2013.<br />
<br />
'''2012'''<br />
* A. Hamza and M. Hefeeda, '''Energy-Efficient Multicasting of Multiview 3D Videos to Mobile Devices''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 8(3s), Article 45, pp. 1--25, September 2012.<br />
<br />
* M. Hefeeda and C. Hsu, '''Design and Evaluation of a Testbed for Mobile TV Networks''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 8(1), Article 3, pp. 1--23, January 2012.<br />
<br />
'''2011'''<br />
<br />
* C. Ly, C. Hsu, and M. Hefeeda, '''A Detour Routing System to Improve Quality of Online Games''', ''IEEE Transactions on Multimedia'', 13(4), pp. 733--747, August 2011. <br />
<br />
* Y. Shen, C. Hsu, and M. Hefeeda, '''Efficient Algorithms for Multi-Sender Data Transmission in Swarm-Based Peer-to-Peer Streaming Systems''', ''IEEE Transactions on Multimedia'', 13(4), pp. 762--775, August 2011.<br />
<br />
* M. Hefeeda, C. Hsu, and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/tc11.pdf Design and Evaluation of a Proxy Cache for Peer to Peer Traffic], ''IEEE Transactions on Computers'', IEEE Transactions on Computers, 60(7), pp. 964--977, July 2011.<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tmc11.pdf Flexible Broadcasting of Scalable Video Streams to Heterogeneous Mobile Devices], ''IEEE Transactions on Mobile Computing'', 10(3), pp. 406--418, March 2011. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_statmux.pdf Statistical Multiplexing of Variable-Bit-Rate Videos Streamed to Mobile Devices], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(2), Article 12, pp. 1--23, February 2011.<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_simu.pdf Using Simulcast and Scalable Video Coding to Control Channel Switching Delay in Mobile TV Broadcast Networks], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(2), Article 8, pp. 1--29, February 2011. <br />
<br />
* S. Sharangi, R. Krishnamurti and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom11_wimax.pdf Energy-efficient Multicasting of Scalable Video Streams over WiMAX Networks], ''IEEE Transactions on Multimedia'', 13(1), pp.102--115, February 2011. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_cross.pdf A Framework for Cross-layer Optimization of Video Streaming in Wireless Networks], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(1), Article 5, pp. 1--28, January 2011.<br />
<br />
'''2010'''<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom10.pdf Authentication of Scalable Video Streams with Low Communication Overhead], ''IEEE Transactions on Multimedia'', 12(7), pp. 730--742, November 2010. <br />
<br />
* M. Hefeeda and B. Noorizadeh, [http://www.cs.sfu.ca/~mhefeeda/Papers/tpds10_caching.pdf On the Benefits of Cooperative Proxy Caching for Peer-to-Peer Traffic], ''IEEE Transactions on Parallel and Distributed Systems'', 21(7), pp. 998--1010, July 2010. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton10_abr.pdf Broadcasting Video Streams Encoded with Arbitrary Bit Rates in Energy-Constrained Mobile TV Networks], ''IEEE/ACM Transactions on Networking'', 18(3), pp. 681--694, June 2010. <br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/tpds10.pdf Energy-Efficient Protocol for Deterministic and Probabilistic Coverage in Sensor Networks], ''IEEE Transactions on Parallel and Distributed Systems'', 21(5), pp. 579--593, May 2010. <br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton10_burst.pdf On Burst Transmission Scheduling in Mobile TV Broadcast Networks], ''IEEE/ACM Transactions on Networking'', 18(2), pp. 610--623, April 2010.<br />
<br />
* M. Hefeeda and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap10_auth.pdf Authentication Schemes for Multimedia Streams: Quantitative Analysis and Comparison], ''ACM Transactions on Multimedia Computing, Communications'', and Applications, 6(1), Article 6, pp. 1--24, February 2010. <br />
<br />
'''2009'''<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/ahswn09b.pdf An Integrated Protocol for Maintaining Connectivity and Coverage under Probabilistic Models for Wireless Sensor Networks], ''Ad Hoc & Sensor Wireless Networks'', 7(3-4), pp. 295--323, April 2009.<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/ahswn09a.pdf Forest Fire Modeling and Early Detection using Wireless Sensor Networks], ''Ad Hoc & Sensor Wireless Networks'', 7(3-4), pp.169--224, April 2009. <br />
<br />
'''2008'''<br />
<br />
* M. Hefeeda and O. Saleh, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton08.pdf Traffic Modeling and Proportional Partial Caching for Peer-to-Peer Systems], ''IEEE/ACM Transactions on Networking'', 16(6), pp. 1447--1460, December 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_rd.pdf On the Accuracy and Complexity of Rate-Distortion Models for FGS-encoded Video Sequences], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 4(2), Article 15, pp. 1--22, May 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08b.pdf Partitioning of Multiple Fine-Grained Scalable Video Sequences Concurrently Streamed to Heterogeneous Clients], ''IEEE Transactions on Multimedia'', 10(3), pp. 457--469, April 2008. <br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_fgs.pdf Rate-Distortion Optimized Streaming of Fine-Grained Scalable Video Sequences], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 4(1), Article 2, pp. 1--28, January 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08.pdf Optimal Coding of Multi-layer and Multi-version Video Streams], ''IEEE Transactions on Multimedia'', 10(1), pp. 121--131, January 2008.<br />
<br />
'''2005'''<br />
<br />
* Y. Tu, J. Sun, M. Hefeeda, Y. Xia, S. Prabhakar, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap05.pdf An Analytical Study of Peer-to-Peer Media Streaming Systems], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 1(4), pp. 354--376, November 2005.<br />
<br />
* M. Hefeeda, A. Habib, D. Xu, B. Bhargava, B. Botev, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsj05.pdf CollectCast: A Peer-to-Peer Service for Media Streaming], ''ACM/Springer Multimedia Systems Journal'', 11(1), pp. 68--81, November 2005.<br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, [http://www.cs.sfu.ca/~mhefeeda/Papers/ieeeComp04Final.pdf Scaling Network Services Using Programmable Network Devices], ''IEEE Computer'', pp. 52--60, April 2005.<br />
<br />
'''2004'''<br />
<br />
* M. Hefeeda, B. Bhargava, D. Yau, [http://www.cs.sfu.ca/~mhefeeda/Papers/comnet04.pdf A Hybrid Architecture for Cost-Effective On-Demand Media Streaming], ''Elsevier Computer Networks'', 44(3), pp. 353--382, February 2004.<br />
<br />
<br />
= Book Chapters/Magazines =<br />
<br />
* M. Hefeeda, C. Hsu, and J. Peters, '''Energy and Bandwidth Optimization and Mobile Video Streaming Systems''', Book Chapter in ''Advanced Video Communications over Wireless Networks'', CRC Press, 2013.<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/IJMAC_editorial.pdf Special Issue on High-Quality Multimedia Streaming in P2P Environments], ''International Journal of Advanced Media and Communications'', Editorial. <br />
<br />
* M. Hefeeda and K. Mokhtarian, '''Authentication of Scalable Multimedia Streams''', Book Chapter in ''Handbook on Security and Networks'', World Scientific Publishing Co., 2011. (Invited)<br />
<br />
* M. Hefeeda and A. Habib, '''Detecting DoS Attacks and Service Violations in QoS-enabled Networks''', Book Chapter in ''Handbook on Security and Networks'', World Scientific Publishing Co., To appear in Summer 2009. (Invited)<br />
<br />
* B. Jules and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07.pdf pCDN: Peer-assisted Content Distribution Network], ''CBC/Radio-Canada Technology Review Magazine'', Issue 4, pp. 1--14, July 2007. (Invited, also published in [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07_french.pdf French]).<br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, [http://www.cs.sfu.ca/~mhefeeda/Papers/ieeeComp04Final.pdf Scaling Network Services Using Programmable Network Devices], ''IEEE Computer'', pp. 52--60, April 2005. <br />
<br />
<br />
= Conferences/Workshops = <br />
<br />
'''2012'''<br />
<br />
* F. Gao, W. Abd-Almageed, and M. Hefeeda, '''Distributed approximate spectral clustering for large-scale datasets''', In Proc. of ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC'12), p. 223--234, Delft, The Netherlands, June 2012.<br />
<br />
* A. Hamza and M. Hefeeda, '''Multicasting Multi-view 3D Videos over Wireless Networks''', In Proc. of ACM Workshop on Mobile Video (MoVid'12), in conjunction with ACM Multimedia Systems 2012, p. 43--48, Chapel Hill, NC, February 2012.<br />
<br />
* A. Dastpak, J. Liu, and M. Hefeeda, '''Video Streaming over Cognitive Radio Networks''', In Proc. of ACM Workshop on Mobile Video (MoVid'12), in conjunction with ACM Multimedia Systems 2012, p. 31--36, Chapel Hill, NC, February 2012.<br />
<br />
* R. C. Harvey and M. Hefeeda, '''Spatio-Temporal Video Copy Detection''', In Proc. of ACM Multimedia Systems (MMSys'12), p. 35--46, Chapel Hill, NC, February 2012.<br />
<br />
* N. Khodabakhshi and M. Hefeeda, '''Copy Detection of 3D Videos''', In Proc. of ACM Multimedia Systems (MMSys'12), p. 131--142, Chapel Hill, NC, February 2012.<br />
<br />
'''2011'''<br />
<br />
* H. Neshat and M. Hefeeda, '''Ranking of New Sponsored Online Ads Using Semantically Related Historical Ads''' , In Proc. of ACM Workshop on Internet Advertising (IA2011), in conjunction with The 34th Annual ACM SIGIR Conference, Beijing, China, July 2011.<br />
<br />
* H. Neshat and M. Hefeeda, '''SmartAd: A Smart System for Effective Advertising in Online Videos''', In Proc. of IEEE International Conference on Multimedia & Expo (ICME'11), Barcelona, Spain, July 2011. '''(Acceptance: 30%)'''<br />
<br />
* F. Tabrizi, J. Peters, and M. Hefeeda, '''Adaptive Transmission of Variable-Bit-Rate Video Streams to Mobile Devices''', In Proc. of IFIP Networking 2011, Valencia, Spain, May 2011.<br />
<br />
'''2010'''<br />
<br />
* R. C. Harvey, A. Hamza, C. Ly, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/netGames10.pdf Energy-Efficient Gaming on Mobile Devices using Dead Reckoning-based Power Management], In Proc. of the 9th Annual Workshop on Network and Systems Support for Games (NetGames'10), 6 pages, Taipei, Taiwan, November 2010. '''(Acceptance: 33%)''' Slides [[media:DRS_NetGames10.pdf | pdf]]<br />
<br />
* C. Ly, C. Hsu, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm10.pdf Improving Online Gaming Quality using Detour Paths], In Proc. of ACM Multimedia 2010, p. 55--64, Firenze, Italy, October 2010. '''(Acceptance: 14% -- Systems Track)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10.pdf pdf]<br />
<br />
* F. Tabrizi, C. Hsu, J. Peters, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/movid10.pdf Optimal Scalable Video Multiplexing in Mobile Broadcast Networks], In Proc. of ACM Workshop on Mobile Video Delivery (MoViD'10), in conjunction with ACM Multimedia 2010, p. 9--14, Firenze, Italy, October 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/movid10.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/movid10.pdf pdf]<br />
<br />
* S. Sharangi, R. Krishnamurti and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos10.pdf Streaming Scalable Video Over WiMAX Networks], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'10), p. 1--9, Beijing, China, June 2010. '''(Acceptance: 25%)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/iwqos10.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_segmentScheduling.pdf Quality-Aware Segment Transmission Scheduling in Peer-to-Peer Streaming Systems], In Proc. of ACM Multimedia Systems (MMSys'10), p. 169--179, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_segmentScheduling.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_segmentScheduling.pdf pdf]<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_p2pAnalysis.pdf Analysis of Peer-assisted Video-on-Demand Systems with Scalable Video Streams], In Proc. of ACM Multimedia Systems (MMSys'10), 12 pages, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_p2pAnalysis.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_p2pAnalysis.pdf pdf]<br />
<br />
* S. Mirshokraie and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_svc-nc.pdf Live Peer-to-Peer Streaming with Scalable Video Coding and Networking Coding], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 123--132, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_svc-nc.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_svc-nc.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_viewingTime.pdf Achieving Viewing Time Scalability in Mobile Video Streaming Using Scalable Video Coding], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 111--122, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_viewingTime.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_viewingTime.pdf pdf]<br />
<br />
* Y. Liu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_coopStreaming.pdf Video Streaming over Cooperative Wireless Networks], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 99--110, Phoenix, AR, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_coopStreaming.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_coopStreaming.pdf pdf]<br />
<br />
'''2009'''<br />
<br />
* G. Kowalski and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/ism09.pdf Empirical Analysis of Multi-Sender Segment Transmission Algorithms in Peer-to-Peer Streaming], In Proc. of IEEE International Symposium on Multimedia (ISM'09), pp. 243--250, San Diego, CA, December 2009. '''(Acceptance: 20%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm09.pdf On Statistical Multiplexing of Variable-Bit-Rate Video Streams in Mobile Systems], In Proc. of ACM Multimedia 2009, pp. 411--420, Beijing, China, October 2009. '''(Acceptance: 18%)'''<br />
<br />
* Y. Liu, C. Hsu, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm09-short.pdf On the Benefits of Cooperative Video Broadcast over WMANs and WLANs], In Proc. of ACM Multimedia 2009, pp. 901--904, Beijing, China, October 2009. '''(Acceptance: 30%)'''<br />
<br />
* A. Berger and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/npsec09.pdf Exploiting SIP for Botnet Communication], In Proc. of Workshop on Secure Network Protocols (NPSec'09), in conjunction with IEEE International Conference on Network Protocols (ICNP'09), pp. 31--36, Princeton, NJ, October 2009. '''(Acceptance: 30%)'''<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos09b.pdf Efficient Allocation of Seed Servers in Peer-to-Peer Streaming Systems with Scalable Videos], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'09), pp. 1-- 9, Charleston, SC, July 2009. <br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/nossdav09.pdf End-to-End Secure Delivery of Scalable Video Streams], In Proc. of International workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'09), pp. 79--84, Williamsburg, VA, June 2009. '''(Acceptance: 30%)''' <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pv09b.pdf Multi-Layer Video Broadcasting with Low Channel Switching Delays], In Proc. of IEEE International Packet Video Workshop (PV'09), pp. 1--10, Seattle, WA, May 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09b.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09b.pdf pdf] <br />
<br />
* M. Hefeeda and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/pv09.pdf Analysis of Authentication Schemes for Nonscalable Video Streams], In Proc. of IEEE International Packet Video Workshop (PV'09), pp. 1--10, Seattle, WA, May 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/networking09.pdf Video Broadcasting to Heterogeneous Mobile Devices], In Proc. of IFIP Networking 2009, Aachen, Germany, May 2009. Published in Springer-Verlag Lecture Notes in Computer Science, LNCS 5550, pp. 600--613, 2009. '''(Acceptance: 20%)''' <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/infocom09.pdf Time Slicing in Mobile TV Broadcast Networks with Arbitrary Channel Bit Rates], In Proc. of IEEE INFOCOM 2009, pp. 2231--2239, Rio de Janeiro, Brazil, April 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom09.pdf pdf] '''(Acceptance: 20%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn09.pdf Bounding Switching Delay in Mobile TV Broadcast Networks], In Proc. of ACM/SPIE Multimedia Computing and Networking Conference (MMCN'09), 12 pages, San Jose, CA, January 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09.pdf pdf] <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn09a.pdf Cross-layer Optimization of Video Streaming in Single-Hop Wireless Networks], In Proc. of ACM/SPIE Multimedia Computing and Networking Conference (MMCN'09), 13 pages, San Jose, CA, January 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09a.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09a.pdf pdf] <br />
<br />
'''2008'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/roads08.pdf ISP-Friendly Peer Matching without ISP Collaboration], International Workshop on Real Overlays & Distributed Systems (ROADS'08), in conjunction with ACM CoNEXT 2008, 6 pages, Madrid, Spain, December 2008. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/roads08.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/roads08.pdf pdf] '''(Acceptance: 30%)'''<br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/innovations08.pdf Energy Optimization in Mobile TV Broadcast Networks], In Proc. of IEEE International Conference on Innovations in Information Technology (Innovations'08), Al Ain, United Arab Emirates, December, 2008. '''[Best Paper Award]'''<br />
<br />
* M. Hefeeda and B. Noorizadeh, [http://www.cs.sfu.ca/~mhefeeda/Papers/lcn08.pdf Cooperative Caching: The Case for P2P Traffic], In Proc. of IEEE Conference on Local Computer Networks (LCN'08), pp. 12--19, Montreal, Canada, October 2008.<br />
<br />
'''2007'''<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/icnp07.pdf A Probabilistic Coverage Protocol for Wireless Sensor Networks], In Proc. of IEEE International Conference on Network Protocols (ICNP'07), pp. 41--50, Beijing, China, October 2007. '''(Acceptance: 15%)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp07.pdf pdf]<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/mass07.pdf Network Connectivity under Probabilistic Communication Models in Wireless Sensor Networks], In Proc. of IEEE International Conference on Mobile Ad-hoc and Sensor Systems (MASS'07), pp. 1--9, Pisa, Italy, October 2007. '''(Acceptance: 25%)'''<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/mass-ghs07.pdf Wireless Sensor Networks for Early Detection of Forest Fires], In Proc. of International Workshop on Mobile Ad hoc and Sensor Systems for Global and Homeland Security (MASS-GHS’07), in conjunction with IEEE MASS’07, pp. 1--6, Pisa, Italy, October 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mass-ghs07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mass-ghs07.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos07.pdf Structuring Multi-Layer Scalable Streams to Maximize Client-Perceived Quality], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'07), pp. 182--187, Chicago, IL, June 2007. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/nossdav07.pdf Optimal Partitioning of Fine-Grained Scalable Video Streams], In Proc. of ACM International Workshop on Network and Operating Systems Support for Digital Audio & Video (NOSSDAV'07), pp. 63--68, Urbana-Champion, IL, June 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/nossdav07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/nossdav07.pdf pdf].<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/infocom07.pdf Randomized k-Coverage Algorithms For Dense Sensor Networks], In Proc. of IEEE INFOCOM 2007 Minisymposium, pp. 2376--2380, Anchorage, AK, May 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom07.pdf pdf]. '''(Acceptance: 25%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn07.pdf Optimal Bit Allocation for Fine-Grained Scalable Video Sequences in Distributed Streaming Environments], In Proc. of 14th ACM/SPIE Multimedia Computing and Networking Conference (MMCN'07), pp. 1--12, San Jose, CA, Jan 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn07.pdf pdf]. '''(Acceptance: 30%)'''<br />
<br />
'''2006'''<br />
<br />
* O. Saleh and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/icnp06.pdf Modeling and Caching of Peer-to-Peer Traffic], In Proc. of IEEE International Conference on Network Protocols (ICNP'06), pp. 249--258, Santa Barbara, CA, November 2006. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp06.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp06.pdf pdf]. '''(Acceptance: 14%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iccta06.pdf Rate-Distortion Models for FGS-encoded Video Sequences], In Proc. of IEEE International Conference on Computer Theory and Applications (ICCTA’06), pp. 334--337, Alexandria, Egypt, September 2006.<br />
<br />
'''2005'''<br />
<br />
* Y. Tu, M. Hefeeda, Y. Xia, and S. Prabhakar, [http://www.cs.sfu.ca/~mhefeeda/Papers/dexa05.pdf Control-based Quality Adaptation in Data Stream Management Systems], In Proc. of 16th International Conference on Database and Expert Systems Applications (DEXA'05), Copenhagen, Denmark, August 2005. Published in Springer-Verlag Lecture Notes in Computer Science, LNCS 3588, pp. 746--755, September 2005.<br />
<br />
'''2003'''<br />
<br />
* M. Hefeeda, A. Habib, B. Botev, D. Xu, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm03.pdf PROMISE: Peer-to-Peer Media Streaming Using CollectCast], In Proc. of ACM Multimedia 2003, pages 45--54, Berkeley, CA, November 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03.pdf pdf]. '''(Acceptance: 17%)'''<br />
<br />
* A. Habib, M. Hefeeda, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/ndss03.pdf Detecting Service Violations and DoS Attacks], In Proc. of Network and Distributed Systems Security Symposium (NDSS'03), pages 177--189, San Diego, CA, February 2003. '''(Acceptance: 21%)'''<br />
<br />
* M. Hefeeda and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/ftdcs03.pdf On-Demand Media Streaming Over the Internet], In Proc. of 9th IEEE Workshop on Future Trends of Distributed Computing Systems (FTDCS'03), pages 279--285, San Juan, Puerto Rico, May, 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/ftdcs03.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/ftdcs03.pdf pdf]. <br />
<br />
'''2002'''<br />
<br />
* D. Xu, M. Hefeeda, S. Hambrush, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/icdcs02.pdf On Peer-to-Peer Media Streaming], In Proc. of IEEE International Conference on Distributed Computing Systems (ICDCS'02), pages 363--371, Vienna, Austria, July 2002. '''(Acceptance: 18%)'''<br />
<br />
'''2001'''<br />
<br />
* Y. Lu , B. Bhargava, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/hhn.pdf An Architecture for Secure Wireless Networking], In Proc. of Workshop on Reliable and Secure Applications in Mobile Environment, New Orleans, October 2001.<br />
<br />
'''2000'''<br />
<br />
* R. A. Ammar, M. Hefeeda, H. Sholl, D. Smarkusky, and B. MacKay, [http://www.cs.sfu.ca/~mhefeeda/Papers/pdcs00.pdf Two-Moment Analysis of a Computation's Performance], International Conf. on Parallel and Distributed Computing and Systems (PDCS'2000), Las Vegas, August 2000.<br />
<br />
'''1996'''<br />
<br />
* R. A. Ammar, T. A. Fergany, A. El-Desouky, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pdcs96.pdf Heuristic Scheduling Algorithms to Access the Critical Section in Shared-Memory Environment], International Conf. on Parallel and Distributed Computing and Systems (PDCS'96), DiJon, France, Sept. 1996.<br />
<br />
= Posters and Demos =<br />
<br />
* M. Hefeeda, K. Choudhary, [http://www.cs.sfu.ca/~mhefeeda/Papers/bcic10.pdf Efficient Multiplexing for Mobile Video Streaming], British Columbia Innovation Council (BCIC) Connect Conference, Vancouver, Canada, October 2010.<br />
<br />
* M. Hefeeda, C. Hsu, and Y. Liu, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08demo_abstract.pdf Testbed and Experiments for Mobile TV (DVB-H) Networks], ACM Multimedia'08 Technical Demonstration, Vancouver, Canada, October 2008. [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08DemoAward.pdf Best Demo Award]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08PhD.pdf Video Communication Systems with Heterogeneous Clients], ACM Multimedia'08 Doctoral Symposium, Vancouver, Canada, October 2008.<br />
<br />
* C. Hsu, N. Chiluka, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster_abstract.pdf ISP-Friendly Peer Matching Algorithms], ACM SIGCOMM'08 Poster, Seattle, WA, August 2008. [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster.pdf Poster: pdf]] [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster.ppt Poster: ppt]].<br />
<br />
* M. Hefeeda, C. Hsu, and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo_abstract.pdf pCache: A Proxy Cache for Peer-to-Peer Traffic], ACM SIGCOMM'08 Technical Demonstration, Seattle, WA, August 2008. [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo.pdf Poster: pdf]] [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo.ppt Poster: ppt]].<br />
<br />
* M. Hefeeda, A. Habib, D. Xu, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.pdf CollectCast: A Tomography-Based Network Service for Peer-to-Peer Streaming], In ACM SIGCOMM'03 Poster Session, Karlsruhe, Germany, August 2003. [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Abstract.pdf Abstract] [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.pdf pdf] [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.ppt ppt]. (Acceptance: 29%)<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm03-doctoral.pdf A Framework for Cost-Effective Peer-to-Peer Content Distribution], In Proc. of ACM Multimedia 2003, Doctoral Symposium, pages 642--643, Berkeley, CA, November 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03_doctoral.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03_doctoral.pdf pdf].<br />
<br />
<br />
= Technical Reports and Manuscripts Under Review =<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pSurvey.pdf Peer-to-Peer Systems: A Comprehensive Survey], School of Computing Science, Simon Fraser University, September 2004.<br />
<br />
* M. Hefeeda, P. Afeche, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pecon2.pdf Economics of a Collaborative Peer-to-Peer Infrastructure for Content Distribution], CS-TR 03-015, Purdue University, May 2003.<br />
<br />
* M. Hefeeda, A. Habib, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pecon1.pdf Cost-Profit Analysis of a Peer-to-Peer Media Streaming Architecture], CERIAS TR 2002-37, Purdue University, October 2002.<br />
<br />
* M. Hefeeda, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/OnMobileCodeSecurity.pdf On Mobile Code Security], CERIAS TR 2001-46, Purdue University, October 2001.<br />
<br />
= Patents = <br />
<br />
* M. Hefeeda, C. Hsu, '''Method for Scalable Broadcasting of Video Streams to Mobile Devices''', US Provisional Patent Application, filed in September 2010.<br />
<br />
* M. Hefeeda, C. Hsu, '''System and Method for Broadcasting Variable-Bit-Rate Video Streams to Mobile Receivers with Energy Constrains''', International Patent Application, filed in August 2010.<br />
<br />
* W. Abd-Almageed, M. Hefeeda, B. Abdelaziz, '''System and Method for Semantic Video Segmentation''', US Provisional Patent Application, filed in April 2010. <br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, '''Discovering Services Supported by Flow Enforcement Devices Through Subgraph Matching''', US Patent Pending, Filed May 2005.<br />
<br />
<br />
= Tutorials =<br />
<br />
* M. Hefeeda and C. Hsu, [http://www.acmmm10.org/program/deepenings/tutorials/#mobile_video_streaming Mobile Video Streaming in Modern Wireless Networks] at the [http://www.acmmm10.org/ ACM Multimedia 2010 Conference]. [http://www.cs.sfu.ca/~mhefeeda/Papers/mm10Tutorial.pdf Summary], Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10Tutorial.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10Tutorial.pdf pdf]</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Publications&diff=5472Publications2013-07-03T03:02:34Z<p>Thegazy: /* Technical Reports and Manuscripts Under Review */</p>
<hr />
<div>= Journals =<br />
<br />
'''2013'''<br />
<br />
* F. Tabrizi, J. Peters, and M. Hefeeda, '''Dynamic Control of Receiver Buffers in Mobile Video Streaming Systems''', ''IEEE Transactions on Mobile Computing'', 12(5), pp. 995--1008, May 2013.<br />
<br />
* N. Khodabakhshi and M. Hefeeda, '''Spider: A System for Finding 3D Video Copies''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 9(1), Article 7, pp. 1--20, February 2013.<br />
<br />
* K. Mokhtarian and M. Hefeeda, '''Capacity Management of Seed Servers in Peer-to-Peer Streaming Systems With Scalable Video Streams''', ''IEEE Transactions on Multimedia'', 15(1), pp. 181--194, January 2013.<br />
<br />
'''2012'''<br />
* A. Hamza and M. Hefeeda, '''Energy-Efficient Multicasting of Multiview 3D Videos to Mobile Devices''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 8(3s), Article 45, pp. 1--25, September 2012.<br />
<br />
* M. Hefeeda and C. Hsu, '''Design and Evaluation of a Testbed for Mobile TV Networks''', ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 8(1), Article 3, pp. 1--23, January 2012.<br />
<br />
'''2011'''<br />
<br />
* C. Ly, C. Hsu, and M. Hefeeda, '''A Detour Routing System to Improve Quality of Online Games''', ''IEEE Transactions on Multimedia'', 13(4), pp. 733--747, August 2011. <br />
<br />
* Y. Shen, C. Hsu, and M. Hefeeda, '''Efficient Algorithms for Multi-Sender Data Transmission in Swarm-Based Peer-to-Peer Streaming Systems''', ''IEEE Transactions on Multimedia'', 13(4), pp. 762--775, August 2011.<br />
<br />
* M. Hefeeda, C. Hsu, and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/tc11.pdf Design and Evaluation of a Proxy Cache for Peer to Peer Traffic], ''IEEE Transactions on Computers'', IEEE Transactions on Computers, 60(7), pp. 964--977, July 2011.<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tmc11.pdf Flexible Broadcasting of Scalable Video Streams to Heterogeneous Mobile Devices], ''IEEE Transactions on Mobile Computing'', 10(3), pp. 406--418, March 2011. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_statmux.pdf Statistical Multiplexing of Variable-Bit-Rate Videos Streamed to Mobile Devices], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(2), Article 12, pp. 1--23, February 2011.<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_simu.pdf Using Simulcast and Scalable Video Coding to Control Channel Switching Delay in Mobile TV Broadcast Networks], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(2), Article 8, pp. 1--29, February 2011. <br />
<br />
* S. Sharangi, R. Krishnamurti and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom11_wimax.pdf Energy-efficient Multicasting of Scalable Video Streams over WiMAX Networks], ''IEEE Transactions on Multimedia'', 13(1), pp.102--115, February 2011. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap11_cross.pdf A Framework for Cross-layer Optimization of Video Streaming in Wireless Networks], ''ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)'', 7(1), Article 5, pp. 1--28, January 2011.<br />
<br />
'''2010'''<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom10.pdf Authentication of Scalable Video Streams with Low Communication Overhead], ''IEEE Transactions on Multimedia'', 12(7), pp. 730--742, November 2010. <br />
<br />
* M. Hefeeda and B. Noorizadeh, [http://www.cs.sfu.ca/~mhefeeda/Papers/tpds10_caching.pdf On the Benefits of Cooperative Proxy Caching for Peer-to-Peer Traffic], ''IEEE Transactions on Parallel and Distributed Systems'', 21(7), pp. 998--1010, July 2010. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton10_abr.pdf Broadcasting Video Streams Encoded with Arbitrary Bit Rates in Energy-Constrained Mobile TV Networks], ''IEEE/ACM Transactions on Networking'', 18(3), pp. 681--694, June 2010. <br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/tpds10.pdf Energy-Efficient Protocol for Deterministic and Probabilistic Coverage in Sensor Networks], ''IEEE Transactions on Parallel and Distributed Systems'', 21(5), pp. 579--593, May 2010. <br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton10_burst.pdf On Burst Transmission Scheduling in Mobile TV Broadcast Networks], ''IEEE/ACM Transactions on Networking'', 18(2), pp. 610--623, April 2010.<br />
<br />
* M. Hefeeda and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap10_auth.pdf Authentication Schemes for Multimedia Streams: Quantitative Analysis and Comparison], ''ACM Transactions on Multimedia Computing, Communications'', and Applications, 6(1), Article 6, pp. 1--24, February 2010. <br />
<br />
'''2009'''<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/ahswn09b.pdf An Integrated Protocol for Maintaining Connectivity and Coverage under Probabilistic Models for Wireless Sensor Networks], ''Ad Hoc & Sensor Wireless Networks'', 7(3-4), pp. 295--323, April 2009.<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/ahswn09a.pdf Forest Fire Modeling and Early Detection using Wireless Sensor Networks], ''Ad Hoc & Sensor Wireless Networks'', 7(3-4), pp.169--224, April 2009. <br />
<br />
'''2008'''<br />
<br />
* M. Hefeeda and O. Saleh, [http://www.cs.sfu.ca/~mhefeeda/Papers/ton08.pdf Traffic Modeling and Proportional Partial Caching for Peer-to-Peer Systems], ''IEEE/ACM Transactions on Networking'', 16(6), pp. 1447--1460, December 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_rd.pdf On the Accuracy and Complexity of Rate-Distortion Models for FGS-encoded Video Sequences], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 4(2), Article 15, pp. 1--22, May 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08b.pdf Partitioning of Multiple Fine-Grained Scalable Video Sequences Concurrently Streamed to Heterogeneous Clients], ''IEEE Transactions on Multimedia'', 10(3), pp. 457--469, April 2008. <br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_fgs.pdf Rate-Distortion Optimized Streaming of Fine-Grained Scalable Video Sequences], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 4(1), Article 2, pp. 1--28, January 2008. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08.pdf Optimal Coding of Multi-layer and Multi-version Video Streams], ''IEEE Transactions on Multimedia'', 10(1), pp. 121--131, January 2008.<br />
<br />
'''2005'''<br />
<br />
* Y. Tu, J. Sun, M. Hefeeda, Y. Xia, S. Prabhakar, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap05.pdf An Analytical Study of Peer-to-Peer Media Streaming Systems], ''ACM Transactions on Multimedia Computing, Communications, and Applications'', 1(4), pp. 354--376, November 2005.<br />
<br />
* M. Hefeeda, A. Habib, D. Xu, B. Bhargava, B. Botev, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsj05.pdf CollectCast: A Peer-to-Peer Service for Media Streaming], ''ACM/Springer Multimedia Systems Journal'', 11(1), pp. 68--81, November 2005.<br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, [http://www.cs.sfu.ca/~mhefeeda/Papers/ieeeComp04Final.pdf Scaling Network Services Using Programmable Network Devices], ''IEEE Computer'', pp. 52--60, April 2005.<br />
<br />
'''2004'''<br />
<br />
* M. Hefeeda, B. Bhargava, D. Yau, [http://www.cs.sfu.ca/~mhefeeda/Papers/comnet04.pdf A Hybrid Architecture for Cost-Effective On-Demand Media Streaming], ''Elsevier Computer Networks'', 44(3), pp. 353--382, February 2004.<br />
<br />
<br />
= Book Chapters/Magazines =<br />
<br />
* M. Hefeeda, C. Hsu, and J. Peters, '''Energy and Bandwidth Optimization and Mobile Video Streaming Systems''', Book Chapter in ''Advanced Video Communications over Wireless Networks'', CRC Press, 2013.<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/IJMAC_editorial.pdf Special Issue on High-Quality Multimedia Streaming in P2P Environments], ''International Journal of Advanced Media and Communications'', Editorial. <br />
<br />
* M. Hefeeda and K. Mokhtarian, '''Authentication of Scalable Multimedia Streams''', Book Chapter in ''Handbook on Security and Networks'', World Scientific Publishing Co., 2011. (Invited)<br />
<br />
* M. Hefeeda and A. Habib, '''Detecting DoS Attacks and Service Violations in QoS-enabled Networks''', Book Chapter in ''Handbook on Security and Networks'', World Scientific Publishing Co., To appear in Summer 2009. (Invited)<br />
<br />
* B. Jules and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07.pdf pCDN: Peer-assisted Content Distribution Network], ''CBC/Radio-Canada Technology Review Magazine'', Issue 4, pp. 1--14, July 2007. (Invited, also published in [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07_french.pdf French]).<br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, [http://www.cs.sfu.ca/~mhefeeda/Papers/ieeeComp04Final.pdf Scaling Network Services Using Programmable Network Devices], ''IEEE Computer'', pp. 52--60, April 2005. <br />
<br />
<br />
= Conferences/Workshops = <br />
<br />
'''2012'''<br />
<br />
* F. Gao, W. Abd-Almageed, and M. Hefeeda, '''Distributed approximate spectral clustering for large-scale datasets''', In Proc. of ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC'12), p. 223--234, Delft, The Netherlands, June 2012.<br />
<br />
* A. Hamza and M. Hefeeda, '''Multicasting Multi-view 3D Videos over Wireless Networks''', In Proc. of ACM Workshop on Mobile Video (MoVid'12), in conjunction with ACM Multimedia Systems 2012, p. 43--48, Chapel Hill, NC, February 2012.<br />
<br />
* A. Dastpak, J. Liu, and M. Hefeeda, '''Video Streaming over Cognitive Radio Networks''', In Proc. of ACM Workshop on Mobile Video (MoVid'12), in conjunction with ACM Multimedia Systems 2012, p. 31--36, Chapel Hill, NC, February 2012.<br />
<br />
* R. C. Harvey and M. Hefeeda, '''Spatio-Temporal Video Copy Detection''', In Proc. of ACM Multimedia Systems (MMSys'12), p. 35--46, Chapel Hill, NC, February 2012.<br />
<br />
* N. Khodabakhshi and M. Hefeeda, '''Copy Detection of 3D Videos''', In Proc. of ACM Multimedia Systems (MMSys'12), p. 131--142, Chapel Hill, NC, February 2012.<br />
<br />
'''2011'''<br />
<br />
* H. Neshat and M. Hefeeda, '''Ranking of New Sponsored Online Ads Using Semantically Related Historical Ads''' , In Proc. of ACM Workshop on Internet Advertising (IA2011), in conjunction with The 34th Annual ACM SIGIR Conference, Beijing, China, July 2011.<br />
<br />
* H. Neshat and M. Hefeeda, '''SmartAd: A Smart System for Effective Advertising in Online Videos''', In Proc. of IEEE International Conference on Multimedia & Expo (ICME'11), Barcelona, Spain, July 2011. '''(Acceptance: 30%)'''<br />
<br />
* F. Tabrizi, J. Peters, and M. Hefeeda, '''Adaptive Transmission of Variable-Bit-Rate Video Streams to Mobile Devices''', In Proc. of IFIP Networking 2011, Valencia, Spain, May 2011.<br />
<br />
'''2010'''<br />
<br />
* R. C. Harvey, A. Hamza, C. Ly, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/netGames10.pdf Energy-Efficient Gaming on Mobile Devices using Dead Reckoning-based Power Management], In Proc. of the 9th Annual Workshop on Network and Systems Support for Games (NetGames'10), 6 pages, Taipei, Taiwan, November 2010. '''(Acceptance: 33%)''' Slides [[media:DRS_NetGames10.pdf | pdf]]<br />
<br />
* C. Ly, C. Hsu, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm10.pdf Improving Online Gaming Quality using Detour Paths], In Proc. of ACM Multimedia 2010, p. 55--64, Firenze, Italy, October 2010. '''(Acceptance: 14% -- Systems Track)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10.pdf pdf]<br />
<br />
* F. Tabrizi, C. Hsu, J. Peters, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/movid10.pdf Optimal Scalable Video Multiplexing in Mobile Broadcast Networks], In Proc. of ACM Workshop on Mobile Video Delivery (MoViD'10), in conjunction with ACM Multimedia 2010, p. 9--14, Firenze, Italy, October 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/movid10.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/movid10.pdf pdf]<br />
<br />
* S. Sharangi, R. Krishnamurti and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos10.pdf Streaming Scalable Video Over WiMAX Networks], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'10), p. 1--9, Beijing, China, June 2010. '''(Acceptance: 25%)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/iwqos10.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_segmentScheduling.pdf Quality-Aware Segment Transmission Scheduling in Peer-to-Peer Streaming Systems], In Proc. of ACM Multimedia Systems (MMSys'10), p. 169--179, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_segmentScheduling.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_segmentScheduling.pdf pdf]<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_p2pAnalysis.pdf Analysis of Peer-assisted Video-on-Demand Systems with Scalable Video Streams], In Proc. of ACM Multimedia Systems (MMSys'10), 12 pages, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_p2pAnalysis.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_p2pAnalysis.pdf pdf]<br />
<br />
* S. Mirshokraie and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_svc-nc.pdf Live Peer-to-Peer Streaming with Scalable Video Coding and Networking Coding], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 123--132, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_svc-nc.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_svc-nc.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_viewingTime.pdf Achieving Viewing Time Scalability in Mobile Video Streaming Using Scalable Video Coding], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 111--122, Phoenix, AZ, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_viewingTime.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_viewingTime.pdf pdf]<br />
<br />
* Y. Liu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsys10_coopStreaming.pdf Video Streaming over Cooperative Wireless Networks], In Proc. of ACM Multimedia Systems (MMSys'10), pp. 99--110, Phoenix, AR, February 2010. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_coopStreaming.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmsys10_coopStreaming.pdf pdf]<br />
<br />
'''2009'''<br />
<br />
* G. Kowalski and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/ism09.pdf Empirical Analysis of Multi-Sender Segment Transmission Algorithms in Peer-to-Peer Streaming], In Proc. of IEEE International Symposium on Multimedia (ISM'09), pp. 243--250, San Diego, CA, December 2009. '''(Acceptance: 20%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm09.pdf On Statistical Multiplexing of Variable-Bit-Rate Video Streams in Mobile Systems], In Proc. of ACM Multimedia 2009, pp. 411--420, Beijing, China, October 2009. '''(Acceptance: 18%)'''<br />
<br />
* Y. Liu, C. Hsu, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm09-short.pdf On the Benefits of Cooperative Video Broadcast over WMANs and WLANs], In Proc. of ACM Multimedia 2009, pp. 901--904, Beijing, China, October 2009. '''(Acceptance: 30%)'''<br />
<br />
* A. Berger and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/npsec09.pdf Exploiting SIP for Botnet Communication], In Proc. of Workshop on Secure Network Protocols (NPSec'09), in conjunction with IEEE International Conference on Network Protocols (ICNP'09), pp. 31--36, Princeton, NJ, October 2009. '''(Acceptance: 30%)'''<br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos09b.pdf Efficient Allocation of Seed Servers in Peer-to-Peer Streaming Systems with Scalable Videos], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'09), pp. 1-- 9, Charleston, SC, July 2009. <br />
<br />
* K. Mokhtarian and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/nossdav09.pdf End-to-End Secure Delivery of Scalable Video Streams], In Proc. of International workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'09), pp. 79--84, Williamsburg, VA, June 2009. '''(Acceptance: 30%)''' <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pv09b.pdf Multi-Layer Video Broadcasting with Low Channel Switching Delays], In Proc. of IEEE International Packet Video Workshop (PV'09), pp. 1--10, Seattle, WA, May 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09b.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09b.pdf pdf] <br />
<br />
* M. Hefeeda and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/pv09.pdf Analysis of Authentication Schemes for Nonscalable Video Streams], In Proc. of IEEE International Packet Video Workshop (PV'09), pp. 1--10, Seattle, WA, May 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/pv09.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/networking09.pdf Video Broadcasting to Heterogeneous Mobile Devices], In Proc. of IFIP Networking 2009, Aachen, Germany, May 2009. Published in Springer-Verlag Lecture Notes in Computer Science, LNCS 5550, pp. 600--613, 2009. '''(Acceptance: 20%)''' <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/infocom09.pdf Time Slicing in Mobile TV Broadcast Networks with Arbitrary Channel Bit Rates], In Proc. of IEEE INFOCOM 2009, pp. 2231--2239, Rio de Janeiro, Brazil, April 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom09.pdf pdf] '''(Acceptance: 20%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn09.pdf Bounding Switching Delay in Mobile TV Broadcast Networks], In Proc. of ACM/SPIE Multimedia Computing and Networking Conference (MMCN'09), 12 pages, San Jose, CA, January 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09.pdf pdf] <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn09a.pdf Cross-layer Optimization of Video Streaming in Single-Hop Wireless Networks], In Proc. of ACM/SPIE Multimedia Computing and Networking Conference (MMCN'09), 13 pages, San Jose, CA, January 2009. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09a.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn09a.pdf pdf] <br />
<br />
'''2008'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/roads08.pdf ISP-Friendly Peer Matching without ISP Collaboration], International Workshop on Real Overlays & Distributed Systems (ROADS'08), in conjunction with ACM CoNEXT 2008, 6 pages, Madrid, Spain, December 2008. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/roads08.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/roads08.pdf pdf] '''(Acceptance: 30%)'''<br />
<br />
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/innovations08.pdf Energy Optimization in Mobile TV Broadcast Networks], In Proc. of IEEE International Conference on Innovations in Information Technology (Innovations'08), Al Ain, United Arab Emirates, December, 2008. '''[Best Paper Award]'''<br />
<br />
* M. Hefeeda and B. Noorizadeh, [http://www.cs.sfu.ca/~mhefeeda/Papers/lcn08.pdf Cooperative Caching: The Case for P2P Traffic], In Proc. of IEEE Conference on Local Computer Networks (LCN'08), pp. 12--19, Montreal, Canada, October 2008.<br />
<br />
'''2007'''<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/icnp07.pdf A Probabilistic Coverage Protocol for Wireless Sensor Networks], In Proc. of IEEE International Conference on Network Protocols (ICNP'07), pp. 41--50, Beijing, China, October 2007. '''(Acceptance: 15%)''' Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp07.pdf pdf]<br />
<br />
* M. Hefeeda and H. Ahmadi, [http://www.cs.sfu.ca/~mhefeeda/Papers/mass07.pdf Network Connectivity under Probabilistic Communication Models in Wireless Sensor Networks], In Proc. of IEEE International Conference on Mobile Ad-hoc and Sensor Systems (MASS'07), pp. 1--9, Pisa, Italy, October 2007. '''(Acceptance: 25%)'''<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/mass-ghs07.pdf Wireless Sensor Networks for Early Detection of Forest Fires], In Proc. of International Workshop on Mobile Ad hoc and Sensor Systems for Global and Homeland Security (MASS-GHS’07), in conjunction with IEEE MASS’07, pp. 1--6, Pisa, Italy, October 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mass-ghs07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mass-ghs07.pdf pdf]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos07.pdf Structuring Multi-Layer Scalable Streams to Maximize Client-Perceived Quality], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'07), pp. 182--187, Chicago, IL, June 2007. <br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/nossdav07.pdf Optimal Partitioning of Fine-Grained Scalable Video Streams], In Proc. of ACM International Workshop on Network and Operating Systems Support for Digital Audio & Video (NOSSDAV'07), pp. 63--68, Urbana-Champion, IL, June 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/nossdav07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/nossdav07.pdf pdf].<br />
<br />
* M. Hefeeda and M. Bagheri, [http://www.cs.sfu.ca/~mhefeeda/Papers/infocom07.pdf Randomized k-Coverage Algorithms For Dense Sensor Networks], In Proc. of IEEE INFOCOM 2007 Minisymposium, pp. 2376--2380, Anchorage, AK, May 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/infocom07.pdf pdf]. '''(Acceptance: 25%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn07.pdf Optimal Bit Allocation for Fine-Grained Scalable Video Sequences in Distributed Streaming Environments], In Proc. of 14th ACM/SPIE Multimedia Computing and Networking Conference (MMCN'07), pp. 1--12, San Jose, CA, Jan 2007. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn07.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mmcn07.pdf pdf]. '''(Acceptance: 30%)'''<br />
<br />
'''2006'''<br />
<br />
* O. Saleh and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/icnp06.pdf Modeling and Caching of Peer-to-Peer Traffic], In Proc. of IEEE International Conference on Network Protocols (ICNP'06), pp. 249--258, Santa Barbara, CA, November 2006. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp06.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/icnp06.pdf pdf]. '''(Acceptance: 14%)'''<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iccta06.pdf Rate-Distortion Models for FGS-encoded Video Sequences], In Proc. of IEEE International Conference on Computer Theory and Applications (ICCTA’06), pp. 334--337, Alexandria, Egypt, September 2006.<br />
<br />
'''2005'''<br />
<br />
* Y. Tu, M. Hefeeda, Y. Xia, and S. Prabhakar, [http://www.cs.sfu.ca/~mhefeeda/Papers/dexa05.pdf Control-based Quality Adaptation in Data Stream Management Systems], In Proc. of 16th International Conference on Database and Expert Systems Applications (DEXA'05), Copenhagen, Denmark, August 2005. Published in Springer-Verlag Lecture Notes in Computer Science, LNCS 3588, pp. 746--755, September 2005.<br />
<br />
'''2003'''<br />
<br />
* M. Hefeeda, A. Habib, B. Botev, D. Xu, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm03.pdf PROMISE: Peer-to-Peer Media Streaming Using CollectCast], In Proc. of ACM Multimedia 2003, pages 45--54, Berkeley, CA, November 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03.pdf pdf]. '''(Acceptance: 17%)'''<br />
<br />
* A. Habib, M. Hefeeda, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/ndss03.pdf Detecting Service Violations and DoS Attacks], In Proc. of Network and Distributed Systems Security Symposium (NDSS'03), pages 177--189, San Diego, CA, February 2003. '''(Acceptance: 21%)'''<br />
<br />
* M. Hefeeda and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/ftdcs03.pdf On-Demand Media Streaming Over the Internet], In Proc. of 9th IEEE Workshop on Future Trends of Distributed Computing Systems (FTDCS'03), pages 279--285, San Juan, Puerto Rico, May, 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/ftdcs03.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/ftdcs03.pdf pdf]. <br />
<br />
'''2002'''<br />
<br />
* D. Xu, M. Hefeeda, S. Hambrush, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/icdcs02.pdf On Peer-to-Peer Media Streaming], In Proc. of IEEE International Conference on Distributed Computing Systems (ICDCS'02), pages 363--371, Vienna, Austria, July 2002. '''(Acceptance: 18%)'''<br />
<br />
'''2001'''<br />
<br />
* Y. Lu , B. Bhargava, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/hhn.pdf An Architecture for Secure Wireless Networking], In Proc. of Workshop on Reliable and Secure Applications in Mobile Environment, New Orleans, October 2001.<br />
<br />
'''2000'''<br />
<br />
* R. A. Ammar, M. Hefeeda, H. Sholl, D. Smarkusky, and B. MacKay, [http://www.cs.sfu.ca/~mhefeeda/Papers/pdcs00.pdf Two-Moment Analysis of a Computation's Performance], International Conf. on Parallel and Distributed Computing and Systems (PDCS'2000), Las Vegas, August 2000.<br />
<br />
'''1996'''<br />
<br />
* R. A. Ammar, T. A. Fergany, A. El-Desouky, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pdcs96.pdf Heuristic Scheduling Algorithms to Access the Critical Section in Shared-Memory Environment], International Conf. on Parallel and Distributed Computing and Systems (PDCS'96), DiJon, France, Sept. 1996.<br />
<br />
= Posters and Demos =<br />
<br />
* M. Hefeeda, K. Choudhary, [http://www.cs.sfu.ca/~mhefeeda/Papers/bcic10.pdf Efficient Multiplexing for Mobile Video Streaming], British Columbia Innovation Council (BCIC) Connect Conference, Vancouver, Canada, October 2010.<br />
<br />
* M. Hefeeda, C. Hsu, and Y. Liu, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08demo_abstract.pdf Testbed and Experiments for Mobile TV (DVB-H) Networks], ACM Multimedia'08 Technical Demonstration, Vancouver, Canada, October 2008. [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08DemoAward.pdf Best Demo Award]<br />
<br />
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm08PhD.pdf Video Communication Systems with Heterogeneous Clients], ACM Multimedia'08 Doctoral Symposium, Vancouver, Canada, October 2008.<br />
<br />
* C. Hsu, N. Chiluka, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster_abstract.pdf ISP-Friendly Peer Matching Algorithms], ACM SIGCOMM'08 Poster, Seattle, WA, August 2008. [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster.pdf Poster: pdf]] [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster.ppt Poster: ppt]].<br />
<br />
* M. Hefeeda, C. Hsu, and K. Mokhtarian, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo_abstract.pdf pCache: A Proxy Cache for Peer-to-Peer Traffic], ACM SIGCOMM'08 Technical Demonstration, Seattle, WA, August 2008. [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo.pdf Poster: pdf]] [[http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08demo.ppt Poster: ppt]].<br />
<br />
* M. Hefeeda, A. Habib, D. Xu, and B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.pdf CollectCast: A Tomography-Based Network Service for Peer-to-Peer Streaming], In ACM SIGCOMM'03 Poster Session, Karlsruhe, Germany, August 2003. [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Abstract.pdf Abstract] [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.pdf pdf] [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm03Poster.ppt ppt]. (Acceptance: 29%)<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mm03-doctoral.pdf A Framework for Cost-Effective Peer-to-Peer Content Distribution], In Proc. of ACM Multimedia 2003, Doctoral Symposium, pages 642--643, Berkeley, CA, November 2003. Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03_doctoral.ppt ppt] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm03_doctoral.pdf pdf].<br />
<br />
<br />
= Technical Reports and Manuscripts Under Review =<br />
<br />
* M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pSurvey.pdf Peer-to-Peer Systems: A Comprehensive Survey], School of Computing Science, Simon Fraser University, September 2004.<br />
<br />
* M. Hefeeda, P. Afeche, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pecon2.pdf Economics of a Collaborative Peer-to-Peer Infrastructure for Content Distribution], CS-TR 03-015, Purdue University, May 2003.<br />
<br />
* M. Hefeeda, A. Habib, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/p2pecon1.pdf Cost-Profit Analysis of a Peer-to-Peer Media Streaming Architecture], CERIAS TR 2002-37, Purdue University, October 2002.<br />
<br />
* M. Hefeeda, B. Bhargava, [http://www.cs.sfu.ca/~mhefeeda/Papers/OnMobileCodeSecurity.pdf On Mobile Code Security], CERIAS TR 2001-46, Purdue University, October 2001 .<br />
<br />
= Patents = <br />
<br />
* M. Hefeeda, C. Hsu, '''Method for Scalable Broadcasting of Video Streams to Mobile Devices''', US Provisional Patent Application, filed in September 2010.<br />
<br />
* M. Hefeeda, C. Hsu, '''System and Method for Broadcasting Variable-Bit-Rate Video Streams to Mobile Receivers with Energy Constrains''', International Patent Application, filed in August 2010.<br />
<br />
* W. Abd-Almageed, M. Hefeeda, B. Abdelaziz, '''System and Method for Semantic Video Segmentation''', US Provisional Patent Application, filed in April 2010. <br />
<br />
* C. Schuba, M. Hefeeda, J. Goldschmidt, M. Speer, '''Discovering Services Supported by Flow Enforcement Devices Through Subgraph Matching''', US Patent Pending, Filed May 2005.<br />
<br />
<br />
= Tutorials =<br />
<br />
* M. Hefeeda and C. Hsu, [http://www.acmmm10.org/program/deepenings/tutorials/#mobile_video_streaming Mobile Video Streaming in Modern Wireless Networks] at the [http://www.acmmm10.org/ ACM Multimedia 2010 Conference]. [http://www.cs.sfu.ca/~mhefeeda/Papers/mm10Tutorial.pdf Summary], Slides [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10Tutorial.pptx pptx] [http://www.cs.sfu.ca/~mhefeeda/Talks/mm10Tutorial.pdf pdf]</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5366Private:progress-hegazy2013-04-18T07:54:44Z<p>Thegazy: /* Dec 2012 to Mar 2013 */</p>
<hr />
<div>==Mar 2013 to Apr 2013==<br />
===Industrial Automation as a Service===<br />
* Overall progress: 70%<br />
* Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
* Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
* Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
* Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
* Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
* Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
* Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
* LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* ''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5365Private:progress-hegazy2013-04-18T07:49:57Z<p>Thegazy: /* Industrial Automation as a Service */</p>
<hr />
<div>==Mar 2013 to Apr 2013==<br />
===Industrial Automation as a Service===<br />
* Overall progress: 70%<br />
* Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
* Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
* Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
* Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
* Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
* Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
* Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
* LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* ''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5364Private:progress-hegazy2013-04-18T07:49:34Z<p>Thegazy: /* Dec 2012 to Mar 2013 */</p>
<hr />
<div>==Mar 2013 to Apr 2013==<br />
===Industrial Automation as a Service===<br />
* Overall progress: 70%<br />
* Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
* Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
* Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
* Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
* Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
* Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
* Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
* LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5363Private:progress-hegazy2013-04-18T07:45:57Z<p>Thegazy: /* Dec 2012 to Mar 2013 */</p>
<hr />
<div>==Mar 2013 to Apr 2013==<br />
===Industrial Automation as a Service===<br />
* Overall progress: 70%<br />
* Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
* Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
* Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
* Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
* Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
* Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
* Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
* LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5362Private:progress-hegazy2013-04-18T07:45:27Z<p>Thegazy: /* Industrial Automation as a Service */</p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===Industrial Automation as a Service===<br />
* Overall progress: 70%<br />
* Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
* Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
* Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
* Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
* Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
* Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
* Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
* LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5361Private:progress-hegazy2013-04-18T07:44:34Z<p>Thegazy: /* Dec 2012 to Mar 2013 */</p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===Industrial Automation as a Service===<br />
Overall progress: 70%<br />
Physical model building: 100% (Note: I have to fix a broken gearbox of solar collector and bidirectional pump leak)<br />
Wiring: 95% (Remaining 5%: wiring missing power circuits when done)<br />
Individual component testing: 100% (Note: I have to re-test the motor with gearbox and the leaking pump when fixed)<br />
Complete system open-loop test: 100% (Note: I have to re-test the solar positioning process after fixing the gearbox)<br />
Complete system feedback test: 60% (Remaining 40%: temperature control loops)<br />
Power circuit design and breadboard testing: 90% (Remaining 10%: tuning the H-bridge circuit for the bidirectional pump and solid state switches for heaters)<br />
Power circuit soldering on printed circuit board: 40% (Remaining 60%: soldering 1 more H-bridge circuit, 5 Darlington pair power amplifiers, 2 solid-state switches)<br />
LabVIEW controller implementation and tuning: 40% (Remaining 60%: controllers for the temperature control loops and adding FT components)<br />
<br />
<br />
Below are the tasks I performed to achieve the progress above. Please note that some of the items were very time consuming due to the nature of the physical labor involved.<br />
* Made about 10 trips to electronics shops in Vancouver, Home Depot, Canadian Tire, and Princess Auto to purchase some tools, and various electronic/electrical components.<br />
* Reorganized the installation of some physical components for better demonstration. For example, I had to craft "spacers" to flip the flowmeters upside down because the bottom of them shows a rotating propeller whose speed indicated the flow. The original installation just shows the solid head of the meter, nothing visual.<br />
* Installed a small heater to emulate solar heat.<br />
* Installed an additional pump for the "steam" cycle; one pump was too weak for the cycle.<br />
* Re-wired the whole system a few times to try to optimize wiring.<br />
* Refined/tested the power circuits for the actuators. <br />
* Soldered them on printed circuit boards. I had to de-solder and solder a couple of times. (very time consuming).<br />
* Crafted (manually) heat sinks for the power transistors; I couldn't find commercially available ones for my design.<br />
* Solved (partially) an issue with the fault tolerance algorithm that has to do with the limited registers in the I/O interface.<br />
<br />
==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5320Private:progress-hegazy2013-03-05T08:19:20Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature).<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** None<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5319Private:progress-hegazy2013-03-05T08:18:13Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published.<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work.<br />
* '''Issues'''<br />
** Progress is very slow.<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments.<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are:<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature)<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** N/A<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5318Private:progress-hegazy2013-03-05T08:17:06Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work<br />
* '''Issues'''<br />
** Progress is very slow<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature)<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
* '''Issues''<br />
** N/A<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5317Private:progress-hegazy2013-03-05T08:16:23Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work<br />
* '''Issues'''<br />
** Progress is very slow<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments<br />
** I added 3 theorems to the formal arguments.<br />
** We finalized and submitted the SIGCOMM paper.<br />
** I prepared the forms of the architecture and smooth handover patents.<br />
** I allocated a few days to provide the necessary material for the patents. <br />
** As for the physical model, I have wired and configured the I/O interface for some control loops.<br />
** I have faced and resolved a number of issues getting individual loops to work. Without going into details, the most important issues are<br />
*** Designing power circuits for the pumps <br />
*** Configuring the Modbus port forwarding to work for Dynamic IP connections.<br />
** I got the cloud controllers to control individual control loops (flow and temperature)<br />
** I am also able to get the fault tolerance algorithm to work. <br />
** To get the delay compensator to work, the main issue that is left for me is to find a solution/workaround for the blocking TCP sockets of LabVIEW. Worse come to worst, I may have to write the protocol myself (something I am trying to avoid so far). <br />
I have received the complete physical model today and took it home for the reason described above. Please let me know if you have an issue with that.<br />
* '''Issues''<br />
** N/A<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5316Private:progress-hegazy2013-03-05T06:06:06Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work<br />
* '''Issues'''<br />
** Progress is very slow<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments<br />
** Work submitted to SIGCOMM.<br />
** Physical plant has been received.<br />
** Control loops have been performed separately. I worked out all the interfacing issues of I/O interfacing and IP addressing.<br />
* '''Issues''<br />
** N/A<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazyhttps://nmsl.cs.sfu.ca/index.php?title=Private:progress-hegazy&diff=5315Private:progress-hegazy2013-03-05T06:05:39Z<p>Thegazy: </p>
<hr />
<div>==Dec 2012 to Mar 2013==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed addressed comments and defended his thesis.<br />
** Another submission has been made and rejected.<br />
* '''Issues'''<br />
** If work not submitted to another conference/workshop, it will likely never get published<br />
* '''Next Steps'''<br />
**N/A<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah got a simplified version of the DP algorithm to work<br />
* '''Issues'''<br />
** Progress is very slow<br />
* '''Next Steps'''<br />
** Abdullah is currently working on an expanded state space<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I performed more emulation experiments<br />
** Work submitted to SIGCOMM.<br />
** Physical plant has been received.<br />
** Control loops have been performed separately. I worked out all the interfacing issues of I/O interfacing and IP addressing.<br />
* '''Issues''<br />
** N/A<br />
* '''Next Steps'''<br />
** I will need to come up with a non-blocking implementation of Modbus/TCP protocol.<br />
** I will <br />
<br />
<br />
<br />
==Oct 29-Nov 23==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this period)<br />
** Ahmed has updated his thesis multiple times and performed more experiments, especially on CPU utilization.<br />
** I have reviewed Ahmed's thesis multiple times and gave him my feedback.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue improving his thesis.<br />
** Ahmed will defend in 2 weeks.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this period)<br />
** Abdullah has switched to a different HPC application and evaluated its model order.<br />
** I put together a plan to traget HPDC.<br />
** Abdullah has performed the literature review and delivered a write-up.<br />
* '''Issues'''<br />
** We cannot explain an anomaly whereby SSD is performing slightly worse than a regular HDD. This happened for 2 HPC applications, even when we artificially made them more I/O intensive. This is really holding us back.<br />
** Time is tight for HPDC.<br />
* '''Next Steps'''<br />
** Abdullah is building a fist order Markov Model to use it in our stochastic dynamic programming.<br />
** I will start writing the introduction and related work section.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this period)<br />
** I have been working on experimentation and writing of the "Automation as a Service" paper.<br />
** I have finished the proposed work section according to our last discussion.<br />
** I held several meetings and phone calls with the controls company and we decided on the physical process and I received an unofficial quotation.<br />
* '''Issues'''<br />
** Paper submission is delayed.<br />
* '''Next Steps'''<br />
** I will continue working on finalizing the paper.<br />
** I should be receiving an official quotation from the controls company soon. We should be making the order shortly.<br />
<br />
<br />
==Oct 22-26==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed is working on writing his thesis and some application-level experimentation.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue the same work.<br />
** I will review any work as soon as it is accomplished<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I reviewed Abdullah's report and sent him my comments<br />
** Abdullah used Kiana's machine temporarily, and managed to understand why the code wasn't utilizing all the cores. We will eventually need a machine with high specs, but I would rather wait until he's done experimenting with what he has. Then, we will have a better idea about the most cost-effective specs for his new machine.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance (not accomplished from last week)<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I met with a person who owns a workshop who is going to manufacturer the physical process. Quotation is due in about a week.<br />
** I am working on the SIGMETRICS paper.<br />
** Ahmed finished the fault tolerance experiments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** I will continue working on the SIGMETRICS paper.<br />
<br />
<br />
==Oct 15-19==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed presented his work at the seminar.<br />
** I had a brief meeting with Ahmed where I explained to him the need for more experiments.<br />
** Ahmed started on addressing Dr. Hefeeda's comments.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will continue working on improving the IPDPS paper.<br />
** Ahmed will start on getting his SDP implementation to work with DB2 application.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah has written up a report, which I am currently reviewing.<br />
** Abdullah tried to get the test HPC application to work on other faster machines but he couldn't.<br />
* '''Issues'''<br />
** Abdullah needs a fast Linux machine because we believe that the problem size of the application cannot be increased due to resource limitation.<br />
* '''Next Steps'''<br />
** Run the example HPC application on SSD and examine the improvement in performance.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have researched process control demo systems.<br />
** I met a representative from Davis Controls where he presented to me a number of Modbus solutions and said he would supply the necessary sensors/actuators and the physical process.<br />
** I dug deeper into the material on control theory for computing systems, and I have some comments and suggestions, which I discussed over the conference call.<br />
* '''Issues'''<br />
** I am still looking for a candidate who could help me on this project with both control and computing background.<br />
* '''Next Steps'''<br />
** I will wrap up the work done so far as we discussed and hopefully make it ready for publication.<br />
** I will meet with the workshop engineer who will manufacture the physical industrial process.<br />
<br />
<br />
==Oct 8-12==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed prepared his seminar presentation for next week.<br />
** I had a meeting with him to give him my feedback/suggestions for the presentation.<br />
** Ahmed reviewed the IPDPS paper and he discussed with me some modifications that need to be made.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is waiting for his meeting with Dr. Hefeeda this week to discuss next steps towards defense.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah obtained a real I/O log from an ocean simulation application.<br />
** We ran the partial autocorrelation function on it. It shows tendency towards a second-order Markov model.<br />
** We discucssed a scaled down version of the testbed, where he would have HDD and ramdisk storage. Using the testbed, we have to show some improvement if we place the most frequently accessed files in the ramdisk.<br />
* '''Issues'''<br />
** Abdullah needs a more powerful machine to serve as the scaled-down version of the testbed; his current machine is slow and low on memory.<br />
* '''Next Steps'''<br />
** Abdullah is to set up his testbed and run some experiments.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I finalized the delay experiments and updated/sent the working document.<br />
** I phone-interviewed the new candidate and sent comments/recommendations to Dr. Hefeeda.<br />
** Ahmed worked on the dual redundancy with "hot swap" experiment.<br />
** I have been doing some research on real Modbus-based processes or how to build one, but I haven't concluded this research yet.<br />
* '''Issues'''<br />
** Lack of clear visioin for the future of this work.<br />
* '''Next Steps'''<br />
** Ahmed is to finish the fault-tolerance experiment.<br />
** I will continue my research on real processes.<br />
<br />
<br />
==Oct 1-5==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed came up with results on application-level testing using Apache-wget.<br />
** I have finished up writing the IPDPS paper and sent it for Dr. Hefeeda to review.<br />
** I have addressed at least 80% of Dr. Hefeeda's comments and submitted the paper to IPDPS.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed is working on updating his report and writing his thesis.<br />
** I have some leftover comments that I will need to address in the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah came up with I/O logs from the benchmark.<br />
** During a one-on-one, I ran partial auto-correlation function (PACF) on the log, and the result is a first-order Markov Chain.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah will come up with logs with the same format from HPC applications. <br />
** We will start working on defining our state space, action space, and reward/penalty function.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** Ahmed successfully ran the delay experiments and obtained results.<br />
** I asked for additional experiments for a different scan cycle, which Ahmed ran on the spot!<br />
** The results show great robustness for up to 6.4 seconds of round-trip delay.<br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Ahmed will run an experiment for dual redundancy.<br />
** I am about to decide on the delay estimator to feed Smith Predictor (for variable delay cases).<br />
<br />
<br />
==Sep 24-28==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** I registered the paper abstract in IPDPS.<br />
** I ported the paper to LaTeX and worked on the abstract, introduction, related work and problem definition.<br />
** Ahmed's code now works with most TCP clients and servers.<br />
* '''Issues'''<br />
** We are running the experiments now (Friday night) and time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** We will finish as much experiments as we can Friday and Saturday.<br />
** I should have the paper (almost) ready Saturday night.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Abdullah; he came up with some file access logs from a benchmark<br />
** We ran the partial autocorrelation function on it to get the Markov order.<br />
** I up with a rough state definition based on the requested blocks (or rather "chunks") and storage status. I also came up with a rough definition for the reward/penalty function based on the same info.<br />
* '''Issues'''<br />
** Progress is a bit slow, but not too bad.<br />
* '''Next Steps'''<br />
** Abdullah is to get more logs from other real HPC applications<br />
** I will continue to define the Markov Decision Process.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I had a couple of meetings with Ahmed where I explained to him in more details what experiments to run.<br />
** Ahmed prepared the testbed based on new cloud instances. He is very close to getting the results.<br />
** I had a Skype call with Ali to explain to him almost the same thing as Ahmed, though Ali is a little behind Ahmed.<br />
* '''Issues'''<br />
** Progress is a bit too slow; we could have easily obtained results this week, but we didn't.<br />
* '''Next Steps'''<br />
** Ahmed should come up with the results soon.<br />
** More experiments (this time, on random delay) are to be conducted.<br />
** Ali should be able to run the same experiments soon (just to get familiar; nothing new to accomplish).<br />
<br />
<br />
==Sep 17-21==<br />
===PCIe Interconnect===<br />
* '''Accomplished''' (this week)<br />
** Ahmed bought and successfully installed the Infiniband cards.<br />
** Benchmark experiments were run for Infiniband.<br />
* '''Issues'''<br />
** Ahmed's implementation of SDP doesn't support asynchronous calls.<br />
** Ahmed couldn't run PCIe and Infiniband experiments from the same machine (library conflict between his SDP and Infiniband SDP) <br />
** Time is tight for the IPDPS submission.<br />
* '''Next Steps'''<br />
** Ahmed will implement asynchronous call support in order to run his application-based evaluation and compare it to Infiniband.<br />
** I will register the paper's abstract to IPDPS over the weekend (deadline is Monday, Sept 24th). <br />
** Although the time is tight, Ahmed will try to finish his asynchronous calls support and the application-based evaluation by the end of next week. This gives us a couple of days to polish up the paper.<br />
<br />
<br />
===HPC Storage===<br />
* '''Accomplished''' (this week)<br />
** Abdullah tried to obtain HPC I/O logs off of the internet. When that was not possible, he tried a couple of benchmarks to to generate some I/O logs as a placeholder until we obtain logs from real HPC applications.<br />
**During our meeting, we tried to analyze the data, e.g., to verify the Markov chain order using partial autocorrelation functions. I noticed the data was so fine-grained (time in nanoseconds and block size in KB). <br />
* '''Issues'''<br />
** None<br />
* '''Next Steps'''<br />
** Abdullah to work on the coarser representation of the log (e.g., 1 second and MBs).<br />
** I will go into one more level of details for the general methodology.<br />
<br />
<br />
===Industrial Automation as a Service===<br />
* '''Accomplished''' (this week)<br />
** I have come up with the delay compensation results and updated the working document.<br />
** I have met with Ahmed AbdelSadek and explained the problem and experiments to him.<br />
** Ali finished his first experiment, which is nothing other than making sure Modbus is working fine for him on LabVIEW.<br />
* '''Issues'''<br />
** Ahmed was supposed to finish his first task by the end of the week, but he was "discussing some issues with Dr. Mohamed regarding [his] research".<br />
** Communication rate with Ali is a bit slow.<br />
* '''Next Steps'''<br />
** I may have to work on the delay experiments myself until Ahmed is up to speed.<br />
** Ahmed will try to accomplish the tasks rolled over from this week.<br />
** I will have conference call with Ali to explain to him the next steps.</div>Thegazy