Difference between revisions of "Network and Multimedia Systems Lab (NMSL)"

From NMSL
 
(192 intermediate revisions by 13 users not shown)
Line 1: Line 1:
 +
__NOTOC__
  
−
We are interested in the broad area of computer networking and distributed systems. We develop algorithms and protocols to enhance the performance of networks, especially the Internet, and to efficiently distribute multimedia content (e.g., video and audio objects) to large-scale user communities. The Network Systems Lab is led by [http://www.cs.sfu.ca/~mhefeeda/ Dr. Mohamed Hefeeda], and is affiliated with the [http://www.cs.sfu.ca/research/groups/NML/ Network Modeling Group] at SFU.
+
'''Welcome to the Network and Multimedia Systems Lab (NMSL) at SFU!'''
  
−
Our current research interests include multimedia networking, peer-to-peer systems, wireless sensor networks, and network security. Some of the currently active projects are listed below.  
+
The Network and Multimedia Systems Lab is led by [http://www.cs.sfu.ca/~mhefeeda/ Dr. Mohamed Hefeeda,] and it is located in the TASC1 building, room 8208.
  
−
== Multimedia Networking ==
+
We are interested in the broad areas of multimedia systems, machine learning, and computer networks. We develop algorithms and systems to efficiently distribute multimedia content to large-scale user communities over wired and wireless networks. We design machine learning models to address important and challenging problems in multimedia and network systems. Our current research projects include hyperspectral imaging, datacenter networking, scalable multicast systems, cloud gaming, multimedia forensics, mobile multimedia, and AR/VR content processing and streaming. In most of our works, we develop prototypes and testbeds to demonstrate the practicality of our solutions and show their performance in actual environments.
−
We are focusing on distributed streaming in dynamic environments in which a receiver is served by multiple senders. We are developing models to understand the characteristics (rate-distortion curves) of the fine-grained scalability of MPEG-4 video sequences. We are also working on methods to infer and model the network paths characteristics (available bandwidth, packet loss rate). Guided by these models, we seek to optimize the streaming quality.  
 
  
−
* Rate-Distortion Optimized Streaming
+
At a high level, our current research interests include:
  
−
* Scalable Multimedia Streaming
+
'''<big>Machine Learning for Multimedia:</big>''' We design learning-based solutions to address complex real-life problems that involve multiple modalities and entities, such as:   
 +
* '''''Multimedia Forensics:''''' detecting makeup attacks in biometric systems using generative adversarial models, fighting content forgery and deepfake using deep watermarking, and detecting food fraud using hyperspectral imaging and deep-learning models. 
 +
* '''''Content Enhancement:''''' removing reflection in images using unsupervised learning models, and up-sampling of rendered contents in cloud gaming using deep learning.
  
−
* Streaming to Wireless and Mobile Devices
 
  
−
* Content-Aware Adaptive Streaming
+
'''<big>Multimedia Networking:</big>''' We design systems for efficient encoding, processing, and delivery of immersive (3D, AR, and VR) multimedia content, such as:
−
   
+
* '''''Augmented and Virtual Reality (AR/VR):''''' automatically converting 2D videos to 3D and VR, and adaptively streaming AR/VR content to heterogeneous receivers.
 +
* '''''Cloud Gaming:''''' designing next-generation cloud gaming systems that optimize video quality, player engagement, and required computing and bandwidth resources.  
  
−
* [[pCDN|'''Peer-assisted Content Distribution Network''']]: Currently, there is a significant interest in the academic and industrial environments to employ the P2P computing paradigm to develop cost-effective content distribution systems over the Internet. Major content distribution networks, such as Akamai, consider the P2P paradigm as a real threat for their content distribution business. This is because the P2P paradigm may in the future achieve similar services with a fraction of the cost. However, there are several research challenges that need to be addressed to enable the P2P paradigm to achieve this potential. In this research, we tackle these research challenges. Our final objective is to develop a fully functional and reliable P2P content distribution system.
 
  
−
* '''Peer to Peer Systems:''' We are exploring the applicability of the P2P paradigm to build cost-effective content distribution systems.  Problems such as sender selection, adaptive object replication,  and content caching are being studied. We are also developing models to analyze the new characteristics of the P2P traffic and the impact of these characteristics on the cache replacement policies and object replication strategies. Furthermore, we are devising analytic models  to study the dynamics of the system capacity and the impact of various parameters on it.  
+
'''<big>Network Protocols and Systems:</big>''' We design protocols and systems to efficiently manage the resources of different networks and support the growing computation and communication demands of machine learning models, such as: 
 +
* '''''Datacenter Multicast:''''' designing scalable multicast systems for datacenters to support efficient group communications patterns common in training machine learning models.   
 +
* '''''ISP and CDN Traffic Management:''''' developing algorithms to support multicast traffic engineering in ISP and CDN networks.
 +
* '''''Datacenter Task Scheduling:''''' designing in-network, fine-grain, schedulers for micro-second scale tasks to support interactive workloads.
  
  
 +
We publish papers in reputable conferences and journals. Most of our Journal Publications are in the premier IEEE and ACM transactions in our areas, such as IEEE Trans. on MM, ACM Trans. on MM, and IEEE/ACM Trans. on Networking. Similarly, most of our Conference Publications are in selective and high-quality conferences, including MM, NSDI, MobiCom, INFOCOM, ICNP, and MMSys.
  
−
* '''Wireless Sensor Networks:''' We are developing algorithms to determine the minimum number of sensors and their distribution to ensure that: (i) each point in a monitored area is within the sensing range of at least <math>K</math> sensors (<math>K</math>-coverage), and (ii) each sensor is within the wireless communication rage of at least <math>C</math> sensors (<math>C</math>-connectivity).  <math>K</math> and <math>C</math> are tunable parameters that depend on the reliability and security requirements of the application considered.  
+
Brief descriptions and links to some of our active and concluded projects are given below.
−
* '''Network Security:''' We are working on methods to assess the trustworthiness of nodes in dynamic systems (such as P2P systems)  and incorporating this information into system protocols such as sender selection. In addition, we are exploring network monitoring techniques to detect and thwart intrusion and denial-of-service attacks in their early stages by observing unusual traffic patterns injected by such attacks.
+
 
 +
== '''Hyperspectral Imaging''' ==
 +
{|
 +
| Hyperspectral cameras capture scenes in many wavelength bands across the spectrum, providing far more information than regular cameras that operate in the visible light range. Hyperspectral imaging can be useful in many commercial/civilian applications such as agricultural research, land-cover mapping, forest monitoring, and mapping of natural disasters, as well as military applications including remote sensing, surveillance, and identification of camouflaged objects.
 +
 
 +
Despite the substantial potential of hyperspectral imaging, its utilization has been limited to a small subset of large-scale military and industrial applications. The long-term goal of this research is to enable the wide adoption of hyperspectral imaging in many real-life applications.
 +
 
 +
'''[[Hyperspectral Imaging|Project Page ...]]'''
 +
 
 +
||  
 +
[[File:Hyperspectral signatures.png|thumb|Hyperspctral imaging.|right]]
 +
|}
 +
 
 +
== '''Cloud Gaming''' ==
 +
{|
 +
|
 +
Cloud gaming enables users to play games on virtually any device. This is achieved by offloading the game rendering and encoding to cloud datacenters. As game resolutions and frame rates increase, cloud gaming platforms face a major challenge to stream high-quality games due to the high bandwidth and low latency requirements.
 +
 
 +
The goal of this project is to design and implement a comprehensive, end-to-end, framework for next-generation cloud gaming systems to optimize the video quality, bitrate, and end-to-end delay.
 +
 
 +
This project is supported by '''AMD Canada''' and an '''NSERC Alliance''' project.
 +
 
 +
'''[[Cloud Gaming | Project Page ...]]'''
 +
 
 +
|| [[File:CloudGaming.png|thumb|Overview of cloud gaming architectures.|right]]
 +
|}
 +
 
 +
== '''Datacenter and ISP Networks''' ==
 +
 
 +
{|
 +
|
 +
We develop algorithms and systems to optimize the performance of datacenter and ISP (Internet Service Provider) Networks. This includes designing scalable multicast systems for datacenters and developing stateless and efficient protocols to support service chaining and multicast traffic engineering in ISP networks.
 +
 
 +
This work was supported by '''Cisco''' and an '''NSERC Strategic''' project.
 +
 
 +
'''[[Scalable Multicast | Project Page ...]]'''
 +
||
 +
[[File:Orca.png|thumb|Design of Orca (multicast system for datacenters). |right]]
 +
|}
 +
 
 +
== '''Immersive and Next-Generation Videos''' ==
 +
{|
 +
| With massive investments in augmented and virtual reality (AR/VR) hardware, companies encounter the challenge of providing VR content. The current solution for installing and operating VR camera rigs is expensive and not scalable. This project provides novel algorithms and methods to automatically convert standard broadcast 2D video streams to 3D and immersive VR streams of high quality. It also provides algorithms for adaptively streaming AR/VR content over the Internet to large-scale receivers.
 +
||
 +
[[File:VR2.jpg|thumb|right|Generating VR content from 2D videos. ]]
 +
|}
 +
 
 +
'''[[Immersive_Videos|Project Page ...]]'''
 +
 
 +
== '''Multimedia Forensics''' ==
 +
{|
 +
| Recent advances in machine learning have made it easier to create fake images and videos. Users and computing systems are facing increasing difficulties in differentiating forged contents from original ones. In this project, we focus on various aspects of detecting fake content, including detecting makeup attacks in biometrics systems and identifying forged videos and images.
 +
 
 +
 
 +
'''[[Multimedia Forensics | Project Page ...]]'''
 +
 
 +
|| 
 +
[[File:MakeupAttacks.png|thumb|right|Sample makeup attacks. ]]
 +
|}
 +
 
 +
 
 +
= '''''[[Concluded Projects]]''''' =
 +
 
 +
Please check [[Concluded Projects | '''this link''']] for some of our previous projects.

Latest revision as of 14:10, 25 October 2023


Welcome to the Network and Multimedia Systems Lab (NMSL) at SFU!

The Network and Multimedia Systems Lab is led by Dr. Mohamed Hefeeda, and it is located in the TASC1 building, room 8208.

We are interested in the broad areas of multimedia systems, machine learning, and computer networks. We develop algorithms and systems to efficiently distribute multimedia content to large-scale user communities over wired and wireless networks. We design machine learning models to address important and challenging problems in multimedia and network systems. Our current research projects include hyperspectral imaging, datacenter networking, scalable multicast systems, cloud gaming, multimedia forensics, mobile multimedia, and AR/VR content processing and streaming. In most of our works, we develop prototypes and testbeds to demonstrate the practicality of our solutions and show their performance in actual environments.

At a high level, our current research interests include:

Machine Learning for Multimedia: We design learning-based solutions to address complex real-life problems that involve multiple modalities and entities, such as:

  • Multimedia Forensics: detecting makeup attacks in biometric systems using generative adversarial models, fighting content forgery and deepfake using deep watermarking, and detecting food fraud using hyperspectral imaging and deep-learning models.
  • Content Enhancement: removing reflection in images using unsupervised learning models, and up-sampling of rendered contents in cloud gaming using deep learning.


Multimedia Networking: We design systems for efficient encoding, processing, and delivery of immersive (3D, AR, and VR) multimedia content, such as:

  • Augmented and Virtual Reality (AR/VR): automatically converting 2D videos to 3D and VR, and adaptively streaming AR/VR content to heterogeneous receivers.
  • Cloud Gaming: designing next-generation cloud gaming systems that optimize video quality, player engagement, and required computing and bandwidth resources.


Network Protocols and Systems: We design protocols and systems to efficiently manage the resources of different networks and support the growing computation and communication demands of machine learning models, such as:

  • Datacenter Multicast: designing scalable multicast systems for datacenters to support efficient group communications patterns common in training machine learning models.
  • ISP and CDN Traffic Management: developing algorithms to support multicast traffic engineering in ISP and CDN networks.
  • Datacenter Task Scheduling: designing in-network, fine-grain, schedulers for micro-second scale tasks to support interactive workloads.


We publish papers in reputable conferences and journals. Most of our Journal Publications are in the premier IEEE and ACM transactions in our areas, such as IEEE Trans. on MM, ACM Trans. on MM, and IEEE/ACM Trans. on Networking. Similarly, most of our Conference Publications are in selective and high-quality conferences, including MM, NSDI, MobiCom, INFOCOM, ICNP, and MMSys.

Brief descriptions and links to some of our active and concluded projects are given below.

Hyperspectral Imaging

Hyperspectral cameras capture scenes in many wavelength bands across the spectrum, providing far more information than regular cameras that operate in the visible light range. Hyperspectral imaging can be useful in many commercial/civilian applications such as agricultural research, land-cover mapping, forest monitoring, and mapping of natural disasters, as well as military applications including remote sensing, surveillance, and identification of camouflaged objects.

Despite the substantial potential of hyperspectral imaging, its utilization has been limited to a small subset of large-scale military and industrial applications. The long-term goal of this research is to enable the wide adoption of hyperspectral imaging in many real-life applications.

Project Page ...

Hyperspctral imaging.

Cloud Gaming

Cloud gaming enables users to play games on virtually any device. This is achieved by offloading the game rendering and encoding to cloud datacenters. As game resolutions and frame rates increase, cloud gaming platforms face a major challenge to stream high-quality games due to the high bandwidth and low latency requirements.

The goal of this project is to design and implement a comprehensive, end-to-end, framework for next-generation cloud gaming systems to optimize the video quality, bitrate, and end-to-end delay.

This project is supported by AMD Canada and an NSERC Alliance project.

Project Page ...

Overview of cloud gaming architectures.

Datacenter and ISP Networks

We develop algorithms and systems to optimize the performance of datacenter and ISP (Internet Service Provider) Networks. This includes designing scalable multicast systems for datacenters and developing stateless and efficient protocols to support service chaining and multicast traffic engineering in ISP networks.

This work was supported by Cisco and an NSERC Strategic project.

Project Page ...

Design of Orca (multicast system for datacenters).

Immersive and Next-Generation Videos

With massive investments in augmented and virtual reality (AR/VR) hardware, companies encounter the challenge of providing VR content. The current solution for installing and operating VR camera rigs is expensive and not scalable. This project provides novel algorithms and methods to automatically convert standard broadcast 2D video streams to 3D and immersive VR streams of high quality. It also provides algorithms for adaptively streaming AR/VR content over the Internet to large-scale receivers.
Generating VR content from 2D videos.

Project Page ...

Multimedia Forensics

Recent advances in machine learning have made it easier to create fake images and videos. Users and computing systems are facing increasing difficulties in differentiating forged contents from original ones. In this project, we focus on various aspects of detecting fake content, including detecting makeup attacks in biometrics systems and identifying forged videos and images.


Project Page ...

Sample makeup attacks.


Concluded Projects

Please check this link for some of our previous projects.

Retrieved from "https://nmsl.cs.sfu.ca/index.php?title=Network_and_Multimedia_Systems_Lab_(NMSL)&oldid=6812"
Powered by MediaWiki