Latest revision as of 13:10, 25 October 2023

Welcome to the Network and Multimedia Systems Lab (NMSL) at SFU!

The Network and Multimedia Systems Lab is led by Dr. Mohamed Hefeeda, and it is located in the TASC1 building, room 8208.

We are interested in the broad areas of multimedia systems, machine learning, and computer networks. We develop algorithms and systems to efficiently distribute multimedia content to large-scale user communities over wired and wireless networks. We design machine learning models to address important and challenging problems in multimedia and network systems. Our current research projects include hyperspectral imaging, datacenter networking, scalable multicast systems, cloud gaming, multimedia forensics, mobile multimedia, and AR/VR content processing and streaming. In most of our works, we develop prototypes and testbeds to demonstrate the practicality of our solutions and show their performance in actual environments.

At a high level, our current research interests include:

Machine Learning for Multimedia: We design learning-based solutions to address complex real-life problems that involve multiple modalities and entities, such as:

Multimedia Forensics: detecting makeup attacks in biometric systems using generative adversarial models, fighting content forgery and deepfake using deep watermarking, and detecting food fraud using hyperspectral imaging and deep-learning models.
Content Enhancement: removing reflection in images using unsupervised learning models, and up-sampling of rendered contents in cloud gaming using deep learning.

Multimedia Networking: We design systems for efficient encoding, processing, and delivery of immersive (3D, AR, and VR) multimedia content, such as:

Augmented and Virtual Reality (AR/VR): automatically converting 2D videos to 3D and VR, and adaptively streaming AR/VR content to heterogeneous receivers.
Cloud Gaming: designing next-generation cloud gaming systems that optimize video quality, player engagement, and required computing and bandwidth resources.

Network Protocols and Systems: We design protocols and systems to efficiently manage the resources of different networks and support the growing computation and communication demands of machine learning models, such as:

Datacenter Multicast: designing scalable multicast systems for datacenters to support efficient group communications patterns common in training machine learning models.
ISP and CDN Traffic Management: developing algorithms to support multicast traffic engineering in ISP and CDN networks.
Datacenter Task Scheduling: designing in-network, fine-grain, schedulers for micro-second scale tasks to support interactive workloads.

We publish papers in reputable conferences and journals. Most of our Journal Publications are in the premier IEEE and ACM transactions in our areas, such as IEEE Trans. on MM, ACM Trans. on MM, and IEEE/ACM Trans. on Networking. Similarly, most of our Conference Publications are in selective and high-quality conferences, including MM, NSDI, MobiCom, INFOCOM, ICNP, and MMSys.

Brief descriptions and links to some of our active and concluded projects are given below.

Hyperspectral Imaging

Hyperspectral cameras capture scenes in many wavelength bands across the spectrum, providing far more information than regular cameras that operate in the visible light range. Hyperspectral imaging can be useful in many commercial/civilian applications such as agricultural research, land-cover mapping, forest monitoring, and mapping of natural disasters, as well as military applications including remote sensing, surveillance, and identification of camouflaged objects.

Despite the substantial potential of hyperspectral imaging, its utilization has been limited to a small subset of large-scale military and industrial applications. The long-term goal of this research is to enable the wide adoption of hyperspectral imaging in many real-life applications.

Project Page ...

Hyperspctral imaging.

Cloud Gaming

Cloud gaming enables users to play games on virtually any device. This is achieved by offloading the game rendering and encoding to cloud datacenters. As game resolutions and frame rates increase, cloud gaming platforms face a major challenge to stream high-quality games due to the high bandwidth and low latency requirements.

The goal of this project is to design and implement a comprehensive, end-to-end, framework for next-generation cloud gaming systems to optimize the video quality, bitrate, and end-to-end delay.

This project is supported by AMD Canada and an NSERC Alliance project.

Project Page ...

Overview of cloud gaming architectures.

Datacenter and ISP Networks

We develop algorithms and systems to optimize the performance of datacenter and ISP (Internet Service Provider) Networks. This includes designing scalable multicast systems for datacenters and developing stateless and efficient protocols to support service chaining and multicast traffic engineering in ISP networks.

This work was supported by Cisco and an NSERC Strategic project.

Project Page ...

Design of Orca (multicast system for datacenters).

Immersive and Next-Generation Videos

With massive investments in augmented and virtual reality (AR/VR) hardware, companies encounter the challenge of providing VR content. The current solution for installing and operating VR camera rigs is expensive and not scalable. This project provides novel algorithms and methods to automatically convert standard broadcast 2D video streams to 3D and immersive VR streams of high quality. It also provides algorithms for adaptively streaming AR/VR content over the Internet to large-scale receivers.

Generating VR content from 2D videos.

Project Page ...

Multimedia Forensics

Recent advances in machine learning have made it easier to create fake images and videos. Users and computing systems are facing increasing difficulties in differentiating forged contents from original ones. In this project, we focus on various aspects of detecting fake content, including detecting makeup attacks in biometrics systems and identifying forged videos and images.

Project Page ...

Sample makeup attacks.

Concluded Projects

Please check this link for some of our previous projects.

@@ Line 1: / Line 1: @@
 __NOTOC__
-'''Welcome to the Network Systems Lab (NSL) at SFU!'''
+'''Welcome to the Network and Multimedia Systems Lab (NMSL) at SFU!'''
+The Network and Multimedia Systems Lab is led by [http://www.cs.sfu.ca/~mhefeeda/ Dr. Mohamed Hefeeda,] and it is located in the TASC1 building, room 8208.
-We are interested in the broad areas of multimedia networking and multimedia systems. We develop algorithms and systems to efficiently distribute multimedia content to large-scale user communities over wired and wireless networks. The Network Systems Lab is led by [http://www.cs.sfu.ca/~mhefeeda/ Dr. Mohamed Hefeeda.] and it is located in the TASC1 building, room 8210.
+We are interested in the broad areas of multimedia systems, machine learning, and computer networks. We develop algorithms and systems to efficiently distribute multimedia content to large-scale user communities over wired and wireless networks. We design machine learning models to address important and challenging problems in multimedia and network systems. Our current research projects include hyperspectral imaging, datacenter networking, scalable multicast systems, cloud gaming, multimedia forensics, mobile multimedia, and AR/VR content processing and streaming. In most of our works, we develop prototypes and testbeds to demonstrate the practicality of our solutions and show their performance in actual environments.
+At a high level, our current research interests include:
-We hold regular [[group meeting]] for discussion and brainstorming.
+'''<big>Machine Learning for Multimedia:</big>''' We design learning-based solutions to address complex real-life problems that involve multiple modalities and entities, such as:
+* '''''Multimedia Forensics:''''' detecting makeup attacks in biometric systems using generative adversarial models, fighting content forgery and deepfake using deep watermarking, and detecting food fraud using hyperspectral imaging and deep-learning models.
+* '''''Content Enhancement:''''' removing reflection in images using unsupervised learning models, and up-sampling of rendered contents in cloud gaming using deep learning.
-Our current research interests include mobile multimedia, immersive and 3D video streaming, and cloud support for mobile and multimedia systems. Brief description and links to currently active projects are given below.
+'''<big>Multimedia Networking:</big>''' We design systems for efficient encoding, processing, and delivery of immersive (3D, AR, and VR) multimedia content, such as:
+* '''''Augmented and Virtual Reality (AR/VR):''''' automatically converting 2D videos to 3D and VR, and adaptively streaming AR/VR content to heterogeneous receivers.
+* '''''Cloud Gaming:''''' designing next-generation cloud gaming systems that optimize video quality, player engagement, and required computing and bandwidth resources.
-== '''Multimedia Networking''' ==
+'''<big>Network Protocols and Systems:</big>'''  We design protocols and systems to efficiently manage the resources of different networks and support the growing computation and communication demands of machine learning models, such as:
+* '''''Datacenter Multicast:''''' designing scalable multicast systems for datacenters to support efficient group communications patterns common in training machine learning models.
+* '''''ISP and CDN Traffic Management:''''' developing algorithms to support multicast traffic engineering in ISP and CDN networks.
+* '''''Datacenter Task Scheduling:''''' designing in-network, fine-grain, schedulers for micro-second scale tasks to support interactive workloads.
-We are focusing on distributed streaming in dynamic environments and for heterogeneous clients.  Our goal is to analyze and understand scalable coding techniques, and to design several optimization and streaming algorithms to make the best possible use of them in real multimedia systems. This will yield better quality for users, and more efficient utilization of network and server resources. We are also  designing algorithms to optimize streaming quality for wireless and mobile clients.
-* '''[[Next-Generation Video]]'''
+We publish papers in reputable conferences and journals. Most of our Journal Publications are in the premier IEEE and ACM transactions in our areas, such as IEEE Trans. on MM, ACM Trans. on MM, and IEEE/ACM Trans. on Networking. Similarly, most of our Conference Publications are in selective and high-quality conferences, including MM, NSDI, MobiCom, INFOCOM, ICNP, and MMSys.
-* '''[[Scalable Multimedia Streaming]]'''
+Brief descriptions and links to some of our active and concluded projects are given below.
-* '''[[hybridStreaming|Hybrid Multicast-Unicast Streaming over Mobile Networks]]'''
+== '''Hyperspectral Imaging''' ==
+{|
+| Hyperspectral cameras capture scenes in many wavelength bands across the spectrum, providing far more information than regular cameras that operate in the visible light range. Hyperspectral imaging can be useful in many commercial/civilian applications such as agricultural research, land-cover mapping, forest monitoring, and mapping of natural disasters, as well as military applications including remote sensing, surveillance, and identification of camouflaged objects.
-* '''[[mobileTV|Mobile TV Networks]]'''
+Despite the substantial potential of hyperspectral imaging, its utilization has been limited to a small subset of large-scale military and industrial applications. The long-term goal of this research is to enable the wide adoption of hyperspectral imaging in many real-life applications.
-* '''[[wimax|Multimedia Streaming over WiMAX Networks]]'''
+'''[[Hyperspectral Imaging|Project Page ...]]'''
+||
+[[File:Hyperspectral signatures.png|thumb|Hyperspctral imaging.|right]]
+|}
-== '''Cloud Computing''' ==
+== '''Cloud Gaming''' ==
+{|
+|
+Cloud gaming enables users to play games on virtually any device. This is achieved by offloading the game rendering and encoding to cloud datacenters. As game resolutions and frame rates increase, cloud gaming platforms face a major challenge to stream high-quality games due to the high bandwidth and low latency requirements.
-We are exploring the opportunities of utilizing new architectures such as GPUs, multi-core processors, and distributed clusters (cloud computing) to efficiently solve research problems related to multimedia content analysis,  large-scale data analysis, and machine learning techniques. We are also designing novel cloud services, such as Automation as Service.
+The goal of this project is to design and implement a comprehensive, end-to-end, framework for next-generation cloud gaming systems to optimize the video quality, bitrate, and end-to-end delay.
-* '''[[cloudAutomation| Industrial Automation as a Cloud Service]]'''
+This project is supported by '''AMD Canada''' and an '''NSERC Alliance''' project.
-* '''[[hpc|Approximation algorithms for Kernel Methods on Multi-core CPUs and GPUs]]'''
+'''[[Cloud Gaming | Project Page ...]]'''
-* '''[[videoInfringement | Video Copy Detection using Cloud Computing]]'''
+|| [[File:CloudGaming.png|thumb|Overview of cloud gaming architectures.|right]]
+|}
+== '''Datacenter and ISP Networks''' ==
-----
+{|
+|
+We develop algorithms and systems to optimize the performance of datacenter and ISP (Internet Service Provider) Networks. This includes designing scalable multicast systems for datacenters and developing stateless and efficient protocols to support service chaining and multicast traffic engineering in ISP networks.
-= '''''Concluded Projects''''' =
+This work was supported by '''Cisco''' and an '''NSERC Strategic''' project.
+'''[[Scalable Multicast | Project Page ...]]'''
+||
+[[File:Orca.png|thumb|Design of Orca (multicast system for datacenters). |right]]
+|}
-== '''Peer-to-Peer Systems''' ==
+== '''Immersive and Next-Generation Videos''' ==
+{|
+| With massive investments in augmented and virtual reality (AR/VR) hardware, companies encounter the challenge of providing VR content.  The current solution for installing and operating VR camera rigs is expensive and not scalable. This project provides novel algorithms and methods to automatically convert standard broadcast 2D video streams to 3D and immersive VR streams of high quality. It also provides algorithms for adaptively streaming AR/VR content over the Internet to large-scale receivers.
+||
+[[File:VR2.jpg|thumb|right|Generating VR content from 2D videos. ]]
+|}
-We are exploring the applicability of the P2P paradigm to build cost-effective content distribution systems.  Problems such as sender selection, adaptive object replication,  and content caching are being studied. We are also developing models to analyze the new characteristics of the P2P traffic and the impact of these characteristics on the cache replacement policies and object replication strategies.
+'''[[Immersive_Videos|Project Page ...]]'''
-Furthermore, we are devising analytic models  to study the dynamics of the P2P system capacity and the impact of various parameters on it.
-* '''[[pCDN|pCDN: Peer-assisted Content Distribution Network]]'''
+== '''Multimedia Forensics''' ==
+{|
+| Recent advances in machine learning have made it easier to create fake images and videos. Users and computing systems are facing increasing difficulties in differentiating forged contents from original ones. In this project, we focus on various aspects of detecting fake content, including detecting makeup attacks in biometrics systems and identifying forged videos and images.
-* '''[[Modeling and Caching of P2P Traffic]]'''
-== '''Online Networked Games''' ==
+'''[[Multimedia Forensics | Project Page ...]]'''
-We are designing various algorithms to improve the performance of online games.
+||
+[[File:MakeupAttacks.png|thumb|right|Sample makeup attacks. ]]
+|}
-* '''[[Minimizing Round-Trip Time in Online Games]]'''
-* '''[[Minimizing Energy Consumption for Online Games on Mobile Phones]]'''
+= '''''[[Concluded Projects]]''''' =
+Please check [[Concluded Projects | '''this link''']] for some of our previous projects.
-== '''Network Security''' ==
-We are exploring network monitoring techniques to detect and thwart intrusion and denial-of-service attacks in their early stages by observing unusual traffic patterns injected by such attacks. We are studying the security of multimedia streaming systems that employ multi-layer and fine-grain scalable video streams.
-* '''[[Security of Scalable Multimedia Streams]]'''
-* '''[[Security of the SIP protocol]]'''
-* '''[[Detecting DoS Attacks and Service Violations in QoS-enabled Networks]]'''
-== '''Wireless Sensor Networks''' ==
-We are developing coverage and connectivity maintenance protocols that consider probabilistic (i.e., more realistic) sensing and communication models. We are also designing protocols that provide controllable degrees of coverage (k-coverage).
-* '''[[Probabilistic Coverage and Connectivity]]'''
-* '''[[K-Coverage and its Application to Forest Fire Detection]]'''

Difference between revisions of "Network and Multimedia Systems Lab (NMSL)"

Latest revision as of 13:10, 25 October 2023

Hyperspectral Imaging

Cloud Gaming

Datacenter and ISP Networks

Immersive and Next-Generation Videos

Multimedia Forensics

Concluded Projects