| Instructor: | Mallesham Dasari |
| Office: | 650D EXP Building |
| Class Times: | MoWed 2:50PM-4:30PM |
| Class Room: | Room 017, Snell Library |
| Office Hours: | MoWed 4:30PM-5:30PM; also on Appointment or open doors |
| Contact: | m.dasari@northeastern.edu |
| Date | Topics | Lecture slides & Readings | Notes |
| 09/04 | Introduction, networked applications, properties, basics of XR systems. | Lecture Slides | |
| 09/09 | XR headsets, internals, hardware, software, and tools. | Lecture Slides , Open3D basics. | |
| 09/11 | Sensors, cameras, depth sensors, lidars, sensing, algorithms. | Lecture Slides | Homework1 out. Due 09/24. |
| 09/16 | 3D data structures, point clouds, depth maps, geometric meshes, neural representations, mono, stereo, and multiview. | Lecture Slides | |
| 09/18 | Capturing 3D data for network transmission, outside-in and inside-out capture, latency and bandwidth trade-offs. | Lecture Slides | |
| 09/23 | Compression fundamentals, 2D video compression. | Lecture Slides | |
| 09/25 | Depth map compression, adopting 2D video codecs, standalone depth compression. | Lecture Slides | Homework2 out. Due 10/08. |
| 09/30 | Point cloud compression, MPEG VPCC, GPCC. | Lecture Slides | |
| 10/02 | Geometric mesh compression, Draco, Inter-frame mesh compression. | Lecture Slides | Project idea due. |
| 10/07 | Machine learning advances in XR content. | ||
| 10/09 | Machine learning advances in XR content compression. | ||
| 10/14 | No class | ||
| 10/16 | Streaming fundamentals, on-demand, conference calls, live broadcasting. | Homework3 out. Due 10/29. | |
| 10/21 | 2D video streaming, adaptive bitrate algorithms. | ||
| 10/23 | 360-degree video streaming. | ||
| 10/28 | Point cloud streaming, point cloud quality metrics, adaptive algorithms. | Project midterm evaluation 1. | |
| 10/30 | Mesh streaming, decimation, mesh quality metrics, adaptive algorithms. | ||
| 11/04 | Progressive transmission of XR content. | ||
| 11/06 | XR Experiences Session | Homework4 out. Due 11/19. | |
| 11/11 | No class | ||
| 11/13 | Class in and about Metaverse. | ||
| 11/18 | Rendering basics, Real time rendering, Performance, Rendering offloading. | ||
| 11/20 | Edge rendering, local streaming, WiFi, mmWave, THz, optical links, challenges and opportunities. | Project midterm evaluation 2. | |
| 11/25 | Hybrid rendering, optimal scheduling, WebRTC. | ||
| 11/27 | No class | ||
| 12/02 | Tracking Fundamentals: Eye tracking, head tracking, outside-in, inside-out tracking | ||
| 12/04 | Tracking Fundamentals: Hand tracking, full body tracking, face tracking | ||
| 12/13 | Final project submission. |
A commitment to the principles of academic integrity is essential to the mission of Northeastern Uni-versity. The promotion of independent and original scholarship ensures that students derive the most from their educational experience and their pursuit of knowledge. Academic dishonesty violates the most fundamental values of an intellectual community and undermines the achievements of the entire University.
As members of the academic community, students must become familiar with their rights and respon-sibilities. In each course, they are responsible for knowing the requirements and restrictions regarding research and writing, examinations of whatever kind, collaborative work, the use of study aids, the appropriateness of assistance, and other issues. Students are responsible for learning the conventions of documentation and acknowledgment of sources in their fields. Northeastern Uni-versity expects students to complete all examinations, tests, papers, creative projects, and assign-ments of any kind according to the highest ethical standards, as set forth either explicitly or implicitly in this Code or by the direction of instructors.
Go to http://www.northeastern.edu/osccr/academic-integrity-policy/ to access the full academic integri-ty policy.
Northeastern University and the Disability Resource Center (DRC) are committed to providing disability services that enable students who qualify under Section 504 of the Rehabilitation Act and the Ameri-cans with Disabilities Act Amendments Act (ADAAA) to participate fully in the activities of the universi-ty. To receive accommodations through the DRC, students must provide appropriate documentation that demonstrates a current substantially limiting disability.
For more information, visit http://www.northeastern.edu/drc/getting-started-with-the-drc
Northeastern University is committed to equal opportunity, affirmative action, diversity and social jus-tice while building a climate of inclusion on and beyond campus. In the classroom, members of the University community work to cultivate an inclusive environment that denounces discrimination through innovation, collaboration and an awareness of global perspectives on social justice.
Please visit http://www.northeastern.edu/oidi/ for complete information on Diversity and Inclusion.
Title IX of the Education Amendments of 1972 protects individuals from sex or gender-based discrim-ination, including discrimination based on gender-identity, in educational programs and activities that receive federal financial assistance. Northeastern’s Title IX Policy prohibits Prohibited Offenses, which are defined as sexual harassment, sexual assault, relationship or domestic violence, and stalking. The Title IX Policy applies to the entire community, including male, female, transgender students, faculty and staff. In case of an emergency, please call 911.
Please visit www.northeastern.edu/titleix for a complete list of reporting options and resources both on- and off-campus