Difference between revisions of "pCDN"

From NMSL
 
(40 intermediate revisions by 7 users not shown)
Line 1: Line 1:
__NOTOC__
+
'''Peer-assisted Content Distribution Network'''
= Peer-assisted Content Distribution Network =
 
We investigate the applicability of the peer-to-peer (P2P) computing paradigm in designing large-scale content distribution systems. The P2P paradigm provides: (i) improved scalability by aggregating resource contributions from peers (end user machines) and reducing the reliance on centralized servers, (ii) reduced cost by utilizing already-deployed resources and eliminating the need for expensive infrastructure, and (iii) rapid deployability by performing all processing at the end systems. The focus of the research is on real-time media streaming for asynchronous client requests distributed over large time scales.
 
  
Currently, there is a significant interest in the academic and industrial environments to employ the P2P computing paradigm to develop cost-effective content distribution systems over the Internet. Major content distribution networks, such as Akamai, consider the P2P paradigm as a real threat for their content distribution business. This is because the P2P paradigm may in the future achieve similar services with a fraction of the cost. However, there are several research challenges that need to be addressed to enable the P2P paradigm to achieve this potential. In this research, we tackle these research challenges. Our final objective is to develop a fully functional and reliable P2P content distribution system.
+
This project employs the peer-to-peer (P2P) computing paradigm in designing large-scale content distribution systems. The P2P paradigm provides: (i) improved scalability by aggregating resource contributions from peers (end user machines) and reducing the reliance on centralized servers, (ii) reduced cost by utilizing already-deployed resources and eliminating the need for expensive infrastructure, and (iii) rapid deployability by performing all processing at the end systems.  
 +
 
 +
Major content distribution networks, such as Akamai, consider the P2P paradigm as a real threat for their content distribution business. This is because the P2P paradigm may achieve similar services with a fraction of the cost. However, there are several research challenges that need to be addressed to enable the P2P paradigm to achieve this potential. In this research, we tackle these research challenges. Our goal is to develop a fully functional and reliable P2P content distribution system, which we call pCDN. Several steps have been made towards that goal. In fact, we already have a  beta version of pCDN 1.0.
 +
 
 +
pCDN will provide high-quality multimedia content, support heterogeneous clients, impose minimal load on the expensive inter-ISP links, provide on-demand as well as live streaming services, ensure data integrity, implement digital rights management, among other features. All features are based on novel algorithms developed by our group. An overview of pCDN and its features can be found in this [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07.pdf White Paper.] The white paper also summarizes the main differences between pCDN and common P2P file-sharing systems such as BitTorrent and Gnutella.
 +
 
 +
pCDN is developed in partnership with the [http://www.cbc.ca Canadian Broadcasting Corporation] (CBC). CBC is the largest Internet content provider in Canada with millions of online users consuming a huge amount of bandwidth, which costs CBC millions of dollars each year. The objective of pCDN is to offset some of these costs while providing better streaming services to clients. pCDN 1.0 is currently in the final testing phases by CBC to be released to the public. Testing is being performed on small Internet streaming services, and the system will gradually evolve to larger-scale important services.
 +
 
 +
Funding for the pCDN project is provided by a research grant from CRD and RTI grants from [http://www.nserc.ca NSERC], and a few [http://www.mitacs.ca MITACS] Research Internships. We appreciate their support.
 +
 
 +
 
 +
== People ==
 +
 
 +
* [http://www.cs.sfu.ca/~mhefeeda/ Mohamed Hefeeda]
 +
 
 +
* François Conway, (CBC, Senior Director, Technology, Strategy and Planning)
 +
 
 +
* Bernard Jules (CBC,  Senior Project Manager, Internet and New Media Technology)
 +
 
 +
 
 +
* [http://www.sfu.ca/~aah10/ Ahmed Hamza] (PhD student)
 +
 
 +
* Patrick Morin (CBC, Technical Support, Internet and New Media Technology)
 +
 
 +
* Patrice Charbonneau (CBC, Technical Support, Internet and New Media Technology)
 +
 
 +
 
 +
* [http://www.sfu.ca/~cha16/ ChengHsin Hsu] (PhD student, Graduated Fall 2009)
 +
 
 +
* [http://www.cs.sfu.ca/~kma26/personal/ Kianoosh Mokhtarian] (MSc Student, Graduated Fall 2009)
 +
 
 +
* Vikas Kumar, Graduate (Research Assistant/Software Engineer, May -- July 2008)  [[Private:vikas_kumar|Progress Report]]
 +
 
 +
* Nitin Chiluka (Research Assistant/Software Engineer, December 2007 -- May 2008)
 +
 
 +
* Pouya Alagheband (NSERC Undergraduate Research Awards, Summer 2007)
 +
 
 +
* Nicolas Gomez (NSERC Undergraduate Research Awards, Summer 2007)
 +
 
 +
* Osama Saleh (MSc Student, Graduated Fall 2006)
 +
 
 +
== On-going Research Problems ==
 +
 
 +
* [[Private:pCDN:Systems Issues|Systems Issues (Login Required)]]
 +
 
 +
* [[Private:pCDN:Peer Matching| ISP-Friendly Peer Matching (Login Required)]]
 +
 
 +
* [[Private:pCDN:NAT|Comprehensive NAT Traversal (Login Required)]]
 +
 
 +
* [[Private:pCDN:DRM| Digital Rights Management (Login Required)]]
 +
 
 +
 
 +
 
 +
== Publications ==
 +
 
 +
* C. Hsu, N. Chiluka, and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/sigcomm08poster_abstract.pdf ISP-Friendly Peer Matching Algorithms], ACM SIGCOMM'08 Poster, Seattle, WA, August 2008.
 +
 
 +
* Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_rd.pdf On the Accuracy and Complexity of Rate-Distortion Models for FGS-encoded Video Sequences], ACM Transactions on Multimedia Computing, Communications, and Applications, 4(2), Article 15, 22 Pages, May 2008. 
 +
 
 +
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08b.pdf Partitioning of Multiple Fine-Grained Scalable Video Sequences Concurrently Streamed to Heterogeneous Clients], IEEE Transactions on Multimedia, 10(3), pp. 457--469, April 2008.
 +
 
 +
* M. Hefeeda and C. Hsu, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap08_fgs.pdf Rate-Distortion Optimized Streaming of Fine-Grained Scalable Video Sequences], ACM Transactions on Multimedia Computing, Communications, and Applications, 4(1), Article 2, 28 Pages, January 2008. 
 +
 
 +
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/tom08.pdf Optimal Coding of Multi-layer and Multi-version Video Streams], IEEE Transactions on Multimedia, 10(1), pp. 121--131, January 2008.
 +
 
 +
* B. Jules and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/pCDN07.pdf pCDN: Peer-assisted Content Distribution Network], CBC/Radio-Canada Technology Review Magazine, Issue 4, pp. 1--14, July 2007. (Invited, also published in French).
 +
 
 +
* Y. Tu, J. Sun, M. Hefeeda, Y. Xia, S. Prabhakar, [http://www.cs.sfu.ca/~mhefeeda/Papers/tomccap05.pdf An Analytical Study of Peer-to-Peer Media Streaming Systems], ACM Transactions on Multimedia Computing,  Communications, and Applications, 1(4),  pp. 354--376, November 2005.
 +
 
 +
* M. Hefeeda, A. Habib, D. Xu, B. Bhargava, B. Botev, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmsj05.pdf CollectCast: A Peer-to-Peer Service for Media Streaming],  ACM/Springer Multimedia Systems Journal, 11(1), pp. 68--81, November 2005.
 +
 
 +
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/iwqos07.pdf Structuring Multi-Layer Scalable Streams to Maximize Client-Perceived Quality], In Proc. of IEEE International Workshop on Quality of Service (IWQoS'07), pp. 182--187, Chicago, IL, June 2007.
 +
 
 +
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/nossdav07.pdf Optimal Partitioning of Fine-Grained Scalable Video Streams], In Proc. of ACM International Workshop on Network and Operating Systems Support for Digital Audio & Video (NOSSDAV'07), pp. 63--68, Urbana-Champion, IL, June 2007. 
 +
 
 +
* C. Hsu and M. Hefeeda, [http://www.cs.sfu.ca/~mhefeeda/Papers/mmcn07.pdf Optimal Bit Allocation for Fine-Grained Scalable Video Sequences in Distributed Streaming Environments], In Proc. of 14th ACM/SPIE Multimedia Computing and Networking Conference (MMCN'07), pp. 1--12, San Jose, CA, Jan 2007.  
  
== Progress ==
 
* [[pCDN:Meeting|Progress Report and Weekly Meeting Minutes]]
 
* [[pCDN:Backlog|Scrum Backlog]]
 
* [[pCDN:Feature|Feature List]]
 
* [[pCDN:Testplan|Test Plan]]
 
* [[pCDN:Restructuring|Restructuring]]
 
* [[pCDN:Geo-Fencing|Geo-Fencing]]
 
  
 
== Software ==
 
== Software ==
* [[pCDN:Release|Release]]
+
 
* [[pCDN:Installation|Installation]]
+
* [[pCDN:Release|Latest Released Version]]
 +
 
 +
* [[pCDN:Installation|Installation Guide]]
 +
 
 +
* [[pCDN:Feature|Features List]]
 +
 
 +
* [https://cs-svn.cs.surrey.sfu.ca/nsl/browser/pCDN Browse Source Code (Subver Server)]
 +
 
 
* [[pCDN:Faq|FAQ]]: Please check the FAQ page before submitting a bug report.
 
* [[pCDN:Faq|FAQ]]: Please check the FAQ page before submitting a bug report.
 +
 
* [[pCDN:Bugreport|Howto Report a Bug]]
 
* [[pCDN:Bugreport|Howto Report a Bug]]
 +
 
* [[pCDN:QA|Quality Assurance]]
 
* [[pCDN:QA|Quality Assurance]]
* [https://cs-svn.cs.surrey.sfu.ca/nsl/browser/pCDN Browse Source code]
+
 
 +
* [[pCDN:develop|Developing new features for pCDN]]: We describe the tools and conventions used in software developments.
  
 
== Documents ==
 
== Documents ==
* [[pCDN:Testplan|Test Plan]]
+
 
* [[pCDN:License|License Agreement]]
+
* [[Private:pCDN:Demo|pCDN Demo Instructions (Login Required)]]
 +
 
 +
* [[Private:pCDN:Design_Document|pCDN Design Document (Login Required)]]
 +
 
 +
* [[Private:pCDN:Extensions|pCDN Future Extensions (Login Required)]]
 +
 
 +
* [[pCDN:Testplan|Software Test Plan]]
 +
 
 +
* [[pCDN:Emulator|Stress-test Emulator]]
 +
 
 +
* [[pCDN:License|Libraries Used and their Licenses]]
 +
 
 
* [[pCDN:Logfile|Log File]]
 
* [[pCDN:Logfile|Log File]]
 +
 
* [[pCDN:Port|Port Assignment]]
 
* [[pCDN:Port|Port Assignment]]
* [[pCDN:Emulator|Stress-test Emulator]]
 
  
== People ==
+
* [[pCDN:Backlog|Scrum Backlog]]
* [http://www.cs.sfu.ca/~mhefeeda/ Mohamed Hefeeda]
+
 
* Cheng-Hsin Hsu (PhD student)
+
* [[pCDN:Progress|Progress and Major Milestones]]
* Majid Bagheri (PhD student)
+
 
* Kianoosh Mokhtarian (M.Sc. student)
+
* A [[media:geo_fencing.doc|requirement document]] for geo fencing.
* Nitin Chiluka (Research Assistant, Spring 2008)
 
* Pouya Alagheband (NSERC Undergraduate Research Awards, Summer 2007)
 
* Nicolas Gomez (NSERC Undergraduate Research Awards, Summer 2007)
 

Latest revision as of 08:30, 14 November 2016

Peer-assisted Content Distribution Network

This project employs the peer-to-peer (P2P) computing paradigm in designing large-scale content distribution systems. The P2P paradigm provides: (i) improved scalability by aggregating resource contributions from peers (end user machines) and reducing the reliance on centralized servers, (ii) reduced cost by utilizing already-deployed resources and eliminating the need for expensive infrastructure, and (iii) rapid deployability by performing all processing at the end systems.

Major content distribution networks, such as Akamai, consider the P2P paradigm as a real threat for their content distribution business. This is because the P2P paradigm may achieve similar services with a fraction of the cost. However, there are several research challenges that need to be addressed to enable the P2P paradigm to achieve this potential. In this research, we tackle these research challenges. Our goal is to develop a fully functional and reliable P2P content distribution system, which we call pCDN. Several steps have been made towards that goal. In fact, we already have a beta version of pCDN 1.0.

pCDN will provide high-quality multimedia content, support heterogeneous clients, impose minimal load on the expensive inter-ISP links, provide on-demand as well as live streaming services, ensure data integrity, implement digital rights management, among other features. All features are based on novel algorithms developed by our group. An overview of pCDN and its features can be found in this White Paper. The white paper also summarizes the main differences between pCDN and common P2P file-sharing systems such as BitTorrent and Gnutella.

pCDN is developed in partnership with the Canadian Broadcasting Corporation (CBC). CBC is the largest Internet content provider in Canada with millions of online users consuming a huge amount of bandwidth, which costs CBC millions of dollars each year. The objective of pCDN is to offset some of these costs while providing better streaming services to clients. pCDN 1.0 is currently in the final testing phases by CBC to be released to the public. Testing is being performed on small Internet streaming services, and the system will gradually evolve to larger-scale important services.

Funding for the pCDN project is provided by a research grant from CRD and RTI grants from NSERC, and a few MITACS Research Internships. We appreciate their support.


People

  • François Conway, (CBC, Senior Director, Technology, Strategy and Planning)
  • Bernard Jules (CBC, Senior Project Manager, Internet and New Media Technology)


  • Patrick Morin (CBC, Technical Support, Internet and New Media Technology)
  • Patrice Charbonneau (CBC, Technical Support, Internet and New Media Technology)


  • Vikas Kumar, Graduate (Research Assistant/Software Engineer, May -- July 2008) Progress Report
  • Nitin Chiluka (Research Assistant/Software Engineer, December 2007 -- May 2008)
  • Pouya Alagheband (NSERC Undergraduate Research Awards, Summer 2007)
  • Nicolas Gomez (NSERC Undergraduate Research Awards, Summer 2007)
  • Osama Saleh (MSc Student, Graduated Fall 2006)

On-going Research Problems


Publications


Software

  • FAQ: Please check the FAQ page before submitting a bug report.

Documents