SIGGRAPH 2024 Technical Papers
← Conference Collections
252 papers in 47 sessions, organized according to the official SIGGRAPH 2024 program. Paper titles link to ACM Digital Library. Awards follow the official awards announcement.
Best Paper Honorable Mention
Monday, 29 July 2024
Fast Radiance Fields
- RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting Zhexi Peng, Tianjia Shao, Yong Liu, Jingke Zhou, Yin Yang, Jingdong Wang, Kun Zhou
- BoostMVSNeRFs: Boosting MVS-based NeRFs to Generalizable View Synthesis in Large-scale Scenes Chih-Hai Su, Chih-Yao Hu, Shr-Ruei Tsai, Jie-Ying Lee, Chin-Yang Lin, Yu-Lun Liu
- A Hierarchical 3D Gaussian Representation for Real-time Rendering of Very Large Scenes Bernhard Kerbl, Andreas Meuleman, Georgios Kopanas, Michael Wimmer, Alexandre Lanvin, George Drettakis
- SMERF: Streamable Memory Efficient Radiance Fields for Real-time Large-scene ExplorationHonorable Mention Daniel Duckworth, Peter Hedman, Christian Reiser, Peter Zhizhin, Jean-François Thibert, Mario Lučić, Richard Szeliski, Jonathan T. Barron
- 2D Gaussian Splatting for Geometrically Accurate Radiance Fields Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao
- StopThePop: Sorted Gaussian Splatting for View-consistent Real-time Rendering Lukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch, Bernhard Kerbl, Markus Steinberger
Fluids and Flows
- A Vortex Particle-on-mesh Method for Soap Film Simulation Ningxiao Tao, Liangwang Ruan, Yitong Deng, Bo Zhu, Bin Wang, Baoquan Chen
- Multi-material Mesh-based Surface Tracking With Implicit Topology Changes Peter Heiss-Synak, Aleksei Kalinov, Malina Strugaru, Arian Etemadi, Huidong Yang, Chris Wojtan
- Kinetic Simulation of Turbulent Multifluid Flows Wei Li, Kui Wu, Mathieu Desbrun
- An Induce-on-Boundary Magnetostatic Solver for Grid-based Ferrofluids Xingyu Ni, Ruicheng Wang, Bin Wang, Baoquan Chen
- Going With the Flow Yousuf Soliman, Marcel Padilla, Oliver Gross, Felix Knöppel, Ulrich Pinkall, Peter Schröder
- Efficient Debris-flow Simulation for Steep Terrain Erosion Aryamaan Jain, Bedrich Benes, Guillaume Cordonnier
Material Texture Generation and Painting
- MaPa: Text-driven Photorealistic Material Painting for 3D Shapes Shangzhan Zhang, Sida Peng, Tao Xu, Yuanbo Yang, Tianrun Chen, Nan Xue, Yujun Shen, Hujun Bao, Ruizhen Hu, Xiaowei Zhou
- Diffusion Texture Painting Anita Hu, Nishkrit Desai, Hassan Abu Alhaija, Seung Wook Kim, Maria Shugrina
- TexPainter: Generative Mesh Texturing With Multi-view Consistency Hongkun Zhang, Zherong Pan, Congyi Zhang, Lifeng Zhu, Xifeng Gao
- TexSliders: Diffusion-based Texture Editing in CLIP Space Julia Guerrero-Viu, Milos Hasan, Arthur Roullier, Midhun Harikumar, Yiwei Hu, Paul Guerrero, Diego Gutiérrez, Belen Masia, Valentin Deschaintre
- DreamMat: High-quality PBR Material Generation With Geometry- and Light-aware Diffusion Models Yuqing Zhang, Yuan Liu, Zhiyu Xie, Lei Yang, Zhongyuan Liu, Mengzhou Yang, Runze Zhang, Qilong Kou, Cheng Lin, Wenping Wang, Xiaogang Jin
- EASI-Tex: Edge-Aware Mesh Texturing from Single Image Sai Raj Kishore Perla, Yizhi Wang, Ali Mahdavi-Amiri, Hao Zhang
Vector Graphics
- Text-to-vector Generation With Neural Path Representation Peiying Zhang, Nanxuan Zhao, Jing Liao
- Deep Sketch Vectorization via Implicit Surface Extraction Chuan Yan, Yong Li, Deepali Aneja, Matthew Fisher, Edgar Simo-Serra, Yotam Gingold
- QT-Font: High-efficiency Font Synthesis via Quadtree-based Diffusion Models Yitian Liu, Zhouhui Lian
- Robust Containment Queries Over Collections of Rational Parametric Curves via Generalized Winding NumbersBest Paper Jacob Spainhour, David Gunderman, Kenneth Weiss
- Minkowski Penalties: Robust Differentiable Constraint Enforcement for Vector Graphics Jiří Minarčík, Sam Estep, Wode Ni, Keenan Crane
- GPU-accelerated Rendering of Vector Brush Strokes Shen Ciao, Zhongyue Guan, Qianxi Liu, Li-Yi Wei, Zeyu Wang
3D Face Generator and Animation
- Portrait3D: Text-guided High-quality 3D Portrait Generation Using Pyramid Representation and GANs Prior Yiqian Wu, Hao Xu, Xiangjun Tang, Xien Chen, Siyu Tang, Zhebin Zhang, Chen Li, Xiaogang Jin
- HeadArtist: Text-conditioned 3D Head Generation With Self Score Distillation Hongyu Liu, Xuan Wang, Ziyu Wan, Yujun Shen, Yibing Song, Jing Liao, Qifeng Chen
- Toonify3D: StyleGAN-based 3D Stylized Face Generator Wonjong Jang, Yucheol Jung, Hyomin Kim, Gwangjin Ju, Chaewon Son, Jooeun Son, Seungyong Lee
- DiffPoseTalk: Speech-driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models Zhiyao Sun, Tian Lv, Sheng Ye, Matthieu Lin, Jenny Sheng, Yu-Hui Wen, Minjing Yu, Yong-Jin Liu
- S3: Speech, Script, and Scene Driven Head and Eye Animation Yifang Pan, Rishabh Agrawal, Karan Singh
- Media2Face: Co-speech Facial Animation Generation With Multi-modality Guidance Qingcheng Zhao, Pengyu Long, Qixuan Zhang, Dafei Qin, Han Liang, Longwen Zhang, Yingliang Zhang, Jingyi Yu, Lan Xu
Generative 3D Geometry
- Coin3D: Controllable and Interactive 3D Assets Generation With Proxy-guided Conditioning Wenqi Dong, Bangbang Yang, Lin Ma, Xiao Liu, Liyuan Cui, Hujun Bao, Yuewen Ma, Zhaopeng Cui
- BlockFusion: Expandable 3D Scene Generation Using Latent Tri-plane Extrapolation Zhennan Wu, Yang Li, Han Yan, Taizhang Shang, Weixuan Sun, Senbo Wang, Ruikai Cui, Weizhe Liu, Hiroyuki Sato, Hongdong Li, Pan Ji
- SketchDream: Sketch-based Text-to-3D Generation and Editing Feng-Lin liu, Hongbo Fu, Yu-Kun Lai, Lin Gao
- DreamFont3D: Personalized Text-to-3D Artistic Font Generation Xiang Li, Lei Meng, Lei Wu, Manyi Li, Xiangxu Meng
- ThemeStation: Generating Theme-aware 3D Assets From Few Exemplars Zhenwei Wang, Tengfei Wang, Gerhard Hancke, Ziwei Liu, Rynson W.H. Lau
- Spice-E: Structural Priors in 3D Diffusion Using Cross-Entity Attention Etai Sella, Gal Fiebelman, Noam Atia, Hadar Averbuch-Elor
Monte Carlo for PDEs
- Velocity-based Monte Carlo Fluids Ryusuke Sugimoto, Christopher Batty, Toshiya Hachisuka
- Walkin’ Robin: Walk on Stars With Robin Boundary ConditionsBest Paper Bailey Miller, Rohan Sawhney, Keenan Crane, Ioannis Gkioulekas
- Neural Monte Carlo Fluid Simulation Pranav Jain, Ziyin Qu, Peter Yichen Chen, Oded Stein
- Stochastic Computation of Barycentric Coordinates Fernando de Goes, Mathieu Desbrun
- Neural Control Variates With Automatic Integration Zilu Li, Guandao Yang, Qingqing Zhao, Xi Deng, Leonidas Guibas, Bharath Hariharan, Gordon Wetzstein
- A Differential Monte Carlo Solver for the Poisson Equation Zihan Yu, Lifan Wu, Zhiqian Zhou, Shuang Zhao
VR, Eye Tracking, Perception
- Saccade-contingent Rendering Yuna Kwak, Eric Penner, Xuan Wang, Mohammad R. Saeedpour-Parizi, Olivier Mercier, Xiuyun Wu, Scott Murdison, Phillip Guan
- Towards Motion Metamers for Foveated Rendering Taimoor Tariq, Piotr Didyk
- Cybersickness Reduction via Gaze-contingent Image Deformation Colin Groth, Marcus Magnor, Steve Grogorick, Martin Eisemann, Piotr Didyk
- Perceptual Evaluation of Steered Retinal Projection Seungjae Lee, Seung-Woo Nam, Kevin Rio, Renate Landig, Hsien-Hui Cheng, Lu Lu, Barry Silverstein
- PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR DisplaysHonorable Mention Kenneth Chen, Thomas Wan, Nathan Matsuda, Ajit Ninan, Alexandre Chapiro, Qi Sun
- Holographic Parallax Improves 3D Perceptual Realism Dongyeon Kim, Seung-Woo Nam, Suyeon Choi, Jong-Mo Seo, Gordon Wetzstein, Yoonchan Jeong
Consistent Text-to-Image
- Training-free Consistent Text-to-image Generation Yoad Tewel, Omri Kaduri, Rinon Gal, Yoni Kasten, Lior Wolf, Gal Chechik, Yuval Atzmon
- Subject-Diffusion: Open Domain Personalized Text-to-image Generation Without Test-time Fine-tuning Jian Ma, Junhao Liang, Chen Chen, Haonan Lu
- The Chosen One: Consistent Characters in Text-to-image Diffusion Models Omri Avrahami, Amir Hertz, Yael Vinker, Moab Arar, Shlomi Fruchter, Ohad Fried, Daniel Cohen-Or, Dani Lischinski
- Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion Boyang Deng, Richard Tucker, Zhengqi Li, Leonidas Guibas, Noah Snavely, Gordon Wetzstein
- Blue Noise for Diffusion Models Xingchang Huang, Corentin Salaun, Cristina Vasconcelos, Christian Theobalt, Cengiz Oztireli, Gurprit Singh
Differentiable Rendering
- Conditional Mixture Path Guiding for Differentiable Rendering Zhimin Fan, Pengcheng Shi, Mufan Guo, Ruoyu Fu, Yanwen Guo, Jie Guo
- Path-space Differentiable Rendering of Implicit Surfaces Siwei Zhou, Youngha Chang, Nobuhiko Mukai, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita, Shuang Zhao
- ZeroGrads: Learning Local Surrogates for Non-differentiable Graphics Michael Fischer, Tobias Ritschel
- Woven Fabric Capture With a Reflection-transmission Photo Pair Yingjie Tang, Zixuan Li, Milos Hasan, Jian Yang, Beibei Wang
Geometry: Reconstruction
- MVD^2: Efficient Multiview 3D Reconstruction for Multiview Diffusion Xin-Yang Zheng, Hao Pan, Yu-Xiao Guo, Xin Tong, Yang Liu
- High-quality Surface Reconstruction Using Gaussian Surfels Pinxuan Dai, Jiamin Xu, Wenxiang Xie, Xinguo Liu, Huamin Wang, Weiwei Xu
- Reach for the Arcs: Reconstructing Surfaces From SDFs via Tangent Points Silvia Sellán, Yingying Ren, Christopher Batty, Oded Stein
- NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects Yuxiang Cai, Jiaxiong Qiu, Zhong Li, Bo Ren
- Part123: Part-aware 3D Reconstruction From a Single-view Image Anran Liu, Cheng Lin, Yuan Liu, Xiaoxiao Long, Zhiyang Dou, Hao-Xiang Guo, Ping Luo, Wenping Wang
- NeurCADRecon: Neural Representation for Reconstructing CAD Surfaces by Enforcing Zero Gaussian Curvature Qiujie Dong, Rui Xu, Pengfei Wang, Shuangmin Chen, Shiqing Xin, Xiaohong Jia, Wenping Wang, Changhe Tu
Shape Analysis
- Consistent Point Orientation for Manifold Surfaces via Boundary Integration Weizhou Liu, Xingce Wang, Haichuan Zhao, Xingfei Xue, Zhongke Wu, Xuequan Lu, Ying He
- A Linear Method to Consistently Orient Normals of a 3D Point Cloud Craig Gotsman, Kai Hormann
- Differentiable Geodesic Distance for Intrinsic Minimization on Triangle Meshes Yue Li, Logan Numerow, Bernhard Thomaszewski, Stelian Coros
- A Heat Method for Generalized Signed Distance Nicole Feng, Keenan Crane
- Navigation-driven Approximate Convex Decomposition James Andrews
- Into the Portal: Directable Fractal Self-Similarity Alexa Schor, Theodore Kim
Tuesday, 30 July 2024
Clothing Geometry
- DressCode: Autoregressively Sewing and Generating Garments From Text GuidanceHonorable Mention Kai He, Kaixin Yao, Qixuan Zhang, Jingyi Yu, Lingjie Liu, Lan Xu
- Proxy Asset Generation for Cloth Simulation in Games Zhongtian Zheng, Tongtong Wang, Qijia Feng, Zherong Pan, Xifeng Gao, Kui Wu
- LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer Siyou Lin, Zhe Li, Zhaoqi Su, Zerong Zheng, Hongwen Zhang, Yebin Liu
- Singular Foliations for Knit Graph Design Rahul Mitra, Erick Jimenez Berumen, Megan Hofmann, Edward Chien
- Automatic Digital Garment Initialization From Sewing Patterns Chen Liu, Weiwei Xu, Yin Yang, Huamin Wang
NeRFs and Lighting
- LightFormer: Light-oriented Global Neural Rendering in Dynamic Scene Haocheng Ren, Yuchi Huo, Yifan Peng, Hongtao Sheng, Weidong Xue, Hongxiang Huang, Jingzhen Lan, Rui Wang, Hujun Bao
- NeRF as a Non-distant Environment Emitter in Physics-based Inverse Rendering Jingwang Ling, Ruihan Yu, Feng Xu, Chun Du, Shuang Zhao
- 3D Gaussian Splatting With Deferred Reflection Keyang Ye, Qiming Hou, Kun Zhou
- Lite2Relight: 3D-aware Single Image Portrait Relighting Pramod Rao, Gereon Fox, Abhimitra Meka, Mallikarjun B R, Fangneng Zhan, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Mohamed Elgharib, Christian Theobalt
- EyeIR: Single Eye Image Inverse Rendering in the Wild Shijun Liang, Haofei Wang, Feng Lu
Simulating Nature
- Differentiable Voronoi Diagrams for Simulation of Cell-based Mechanical Systems Logan Numerow, Yue Li, Stelian Coros, Bernhard Thomaszewski
- Scintilla: Simulating Combustible Vegetation for Wildfires Andrzej Kokosza, Helge Wrede, Daniel Gonzalez Esparza, Milosz Makowski, Daoming Liu, Dominik L. Michels, Soren Pirk, Wojtek Palubicki
- Cyclogenesis: Simulating Hurricanes and Tornadoes Jorge Alejandro Amador Herrera, Jonathan Klein, Daoming Liu, Wojtek Pałubicki, Sören Pirk, Dominik L. Michels
- Real-time Wing Deformation Simulations for Flying Insects Qiang Chen, Zhigang Deng, Feng Li, Yuming Fang, Tingsong Lu, Yang Tong, Yifan Zuo
- Modelling a Feather as a Strongly Anisotropic Elastic Shell Jean Jouve, Victor Romero, Rahul Narain, Laurence Boissieux, Theodore Kim, Florence Bertails-Descoubes
3D Fabrication
- Neural Slicer for Multi-axis 3D Printing Tao Liu, Tianyu Zhang, Yongxue Chen, Yuming Huang, Charlie C.L. Wang
- FlexScale: Modeling and Characterization of Flexible Scaled Sheets Juan Sebastian Montes Maestre, Yinwei Du, Ronan Hinchet, Stelian Coros, Bernhard Thomaszewski
- Modal Folding: Discovering Smooth Folding Patterns for Sheet Materials Using Strain-space Modes Pengbin Tang, Ronan Hinchet, Roi Poranne, Bernhard Thomaszewski, Stelian Coros
- Computational Homogenization for Inverse Design of Surface-based Inflatables Yingying Ren, Julian Panetta, Seiichi Suzuki, Uday Kusupati, Florin Isvoranu, Mark Pauly
- Solid KnittingHonorable Mention Yuichi Hirose, Mark Gillespie, Angelica M. Bonilla Fominaya, James McCann
- Fabric Tessellation: Realizing Freeform Surfaces by SmockingHonorable Mention Aviv Segall, Jing Ren, Amir Vaxman, Olga Sorkine-Hornung
3D People and Their Habitats
- Physics-based Scene Layout Generation From Human Motion Jianan Li, Tao Huang, Qingxu Zhu, Tien-Tsin Wong
- Spatial and Surface Correspondence Field for Interaction Transfer Zeyu Huang, Honghao Xu, Haibin Huang, Chongyang Ma, Hui Huang, Ruizhen Hu
- CharacterGen: Efficient 3D Character Generation From Single Images With Multi-view Pose Canonicalization Hao-Yang Peng, Jia-Peng Zhang, Meng-Hao Guo, Yan-Pei Cao, Shi-Min Hu
- VRMM: A Volumetric Relightable Morphable Head Model Haotian Yang, Mingwu Zheng, Chongyang Ma, Yu-Kun Lai, Pengfei Wan, Haibin Huang
- Compressed Skinning for Facial Blendshapes Ladislav Kavan, John Doublestein, Martin Prazak, Matthew Cioffi, Doug Roble
Fluids
- Lagrangian Covector Fluid With Free Surface Zhiqi Li, Barnabás Börcsök, Duowen Chen, Yutong Sun, Bo Zhu, Greg Turk
- Fluid Control With Laplacian Eigenfunctions Yixin Chen, David Levin, Timothy Langlois
- Eulerian-Lagrangian Fluid Simulation on Particle Flow Maps Junwei Zhou, Duowen Chen, Molin Deng, Yitong Deng, Yuchen Sun, Sinan Wang, Shiying Xiong, Bo Zhu
- Lightning-fast Method of Fundamental SolutionsBest Paper Jiong Chen, Florian Schaefer, Mathieu Desbrun
Geometric Modeling & Analysis
- Spin-It Faster: Quadrics Solve All Topology Optimization Problems That Depend Only on Mass MomentsHonorable Mention Christian Hafner, Mickaël Ly, Chris Wojtan
- X-SLAM: Scalable Dense SLAM for Task-aware Optimization Using CSFD Zhexi Peng, Yin Yang, Tianjia Shao, Chenfanfu Jiang, Kun Zhou
- CWF: Consolidating Weak Features in High-quality Mesh Simplification Rui Xu, Longdu Liu, Ningna Wang, Shuangmin Chen, Shiqing Xin, Xiaohu Guo, Zichun Zhong, Taku Komura, Wenping Wang, Changhe Tu
- Alignment Conditions for NURBS-based Design of Mixed Tension-compression Grid Shells Masaaki Miki, Toby Mitchell
- Adaptive Grid Generation for Discretizing Implicit Complexes Yiwen Ju, Xingyi Du, Qingnan Zhou, Nathan Carr, Tao Ju
Wednesday, 31 July 2024
3D Head Avatars From Data
- MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar Yufan Chen, Lizhen Wang, Qijing Li, Hongjiang Xiao, Shengping Zhang, Hongxun Yao, Yebin Liu
- InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars Xiaochen Zhao, Jingxiang Sun, Lizhen Wang, Jinli Suo, Yebin Liu
- 3D Gaussian Blendshapes for Head Avatar Animation Shengjie Ma, Yanlin Weng, Tianjia Shao, Kun Zhou
- Universal Facial Encoding of Codec Avatars From VR Headsets Shaojie Bai, Te-Li Wang, Chenghui Li, Akshay Venkatesh, Tomas Simon, Chen Cao, Gabriel Schwartz, Jason Saragih, Yaser Sheikh, Shih-En Wei
- Learning a Generalized Physical Face Model From Data Lingchen Yang, Gaspard Zoss, Prashanth Chandran, Markus Gross, Barbara Solenthaler, Eftychios Sifakis, Derek Bradley
Geometry: Mappings and Fields
Motion Capture
- Towards Unstructured Unlabeled Optical Mocap: A Video Helps! Nicholas Milef, John Keyser, Shu Kong
- Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capture Xinyu Yi, Yuxiao Zhou, Feng Xu
- Ultra Inertial Poser: Scalable Motion Capture and Tracking From Sparse Inertial Sensors and Ultra-Wideband Ranging Rayan Armani, Changlin Qian, Jiaxi Jiang, Christian Holz
- Audio Matters Too! Enhancing Markerless Motion Capture With Audio Signals for String Performance Capture Yitong Jin, Zhiping Qiu, Yi Shi, Shuangpeng Sun, Chongwu Wang, Donghao Pan, Jiachen Zhao, Zhenghao Liang, Yuan Wang, Xiaobing Li, Feng Yu, Tao Yu, Qionghai Dai
- Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions With Physics Haoyu Hu, Xin-yu Yi, Zhe Cao, Jun-Hai Yong, Feng Xu
- Physics-informed Learning of Characteristic Trajectories for Smoke Reconstruction Yiming Wang, Siyu Tang, Mengyu Chu
Real-Time Rendering: Hair, Fabrics, and Super-Resolution
- Real-time Physically Guided Hair Interpolation Jerry Hsu, Tongtong Wang, Zherong Pan, Xifeng Gao, Cem Yuksel, Kui Wu
- Real-time Hair Rendering With Hair Meshes Gaurav Bhokare, Eisen Montalvo, Elie Diaz, Cem Yuksel
- Modeling Hair Strands With Roving Capsules Alexander Reshetov, David Hart
- Real-time Neural Woven Fabric Rendering Xiang Chen, Lu Wang, Beibei Wang
- Mob-FGSR: Frame Generation and Super Resolution for Mobile Real-time Rendering Sipeng Yang, Qingchuan Zhu, Junhao Zhuge, Qiang Qiu, Chen Li, Yuzhong Yan, Huihui Xu, Ling-Qi Yan, Xiaogang Jin
- Deep Fourier-based Arbitrary-scale Super-resolution for Real-time Rendering Haonan Zhang, Jie Guo, Jiawei Zhang, Haoyu Qin, Zesen Feng, Ming Yang, Yanwe Guo
Character Animation From Data
- LGTM: Local-to-Global Text-driven Human Motion Diffusion Model Haowen Sun, Ruikun Zheng, Haibin Huang, Chongyang Ma, Hui Huang, Ruizhen Hu
- Taming Diffusion Probabilistic Models for Character Control Rui Chen, Mingyi Shi, Shaoli Huang, Ping Tan, Taku Komura, Xuelin Chen
- TEDi: Temporally-Entangled Diffusion for Long-term Motion Synthesis Zihan Zhang, Richard Liu, Rana Hanocka, Kfir Aberman
- Flexible Motion In-betweening With Diffusion Models Setareh Cohan, Guy Tevet, Daniele Reda, Xue Bin Peng, Michiel van de Panne
- WalkTheDog: Cross-morphology Motion Alignment via Phase Manifolds Peizhuo Li, Sebastian Starke, Yuting Ye, Olga Sorkine-Hornung
- Iterative Motion Editing With Natural Language Purvi Goel, Kuan-Chieh Wang, C. Karen Liu, Kayvon Fatahalian
Lighting and Matting With Image Generation
- DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation Chong Zeng, Yue Dong, Pieter Peers, Youkang Kong, Hongzhi Wu, Xin Tong
- IntrinsicDiffusion: Joint Intrinsic Layers From Latent Diffusion Models Jundan Luo, Duygu Ceylan, Jae Shin Yoon, Nanxuan Zhao, Julien Philip, Anna Frühstück, Wenbin Li, Christian Richardt, Tuanfeng Wang
- Transparent Image Layer Diffusion Using Latent Transparency Lvmin Zhang, Maneesh Agrawala
- RGB↔X: Image Decomposition and Synthesis Using Material- and Lighting-aware Diffusion Models Zheng Zeng, Valentin Deschaintre, Iliyan Georgiev, Yannick Hold-Geoffroy, Yiwei Hu, Fujun Luan, Ling-Qi Yan, Miloš Hašan
- Matting by Generation Zhixiang Wang, Baiang Li, Jian Wang, Yu-Lun Liu, Jinwei Gu, Yung-Yu Chuang, Shin'ichi Satoh
Rendering, Sampling and Tracing
- Stylized Rendering as a Function of Expectation Rex West, Sayan Mukherjee
- Proxy Tracing: Unbiased Reciprocal Estimation for Optimized Sampling in BDPT Fujia Su, Bingxuan Li, Qingyang Yin, Yanchen Zhang, Sheng Li
- Area ReSTIR: Resampling for Real-time Defocus and Antialiasing Song Zhang, Daqi Lin, Markus Kettunen, Chris Wyman, Cem Yuksel
- Ray Tracing Harmonic FunctionsHonorable Mention Mark Gillespie, Denise Yang, Mario Botsch, Keenan Crane
- Quad-optimized Low-discrepancy Sequences Victor Ostromoukhov, David Coeurjolly, Nicolas Bonneel, Jean-Claude Iehl
Virtual Interaction and Real Devices
- Dragon's Path: Synthesizing User-centered Flying Creature Animation Paths for Outdoor Augmented Reality Experiences Minyoung Kim, Rawan Alghofaili, Changyang Li, Lap-Fai Yu
- VR-GS: A Physical Dynamics-aware Interactive Gaussian Splatting System in Virtual Reality Ying Jiang, Chang Yu, Tianyi Xie, Xuan Li, Yutao Feng, Huamin Wang, Minchen Li, Henry Lau, Feng Gao, Yin Yang, Chenfanfu Jiang
- 3D-Layers: Bringing Layer-based Color Editing to VR Painting Emilie Yu, Fanny Chevalier, Karan Singh, Adrien Bousseau
- NICER: A New and Improved Consumed Endurance and Recovery Metric to Quantify Muscle Fatigue of Mid-air Interactions Yi Li, Benjamin Tag, Shaozhang Dai, Robert Crowther, Tim Dwyer, Pourang Irani, Barrett Ens
- Capacitive Touch Sensing on General 3D SurfacesHonorable Mention Gianpaolo Palma, Narges Pourjafarian, Jürgen Steimle, Paolo Cignoni
- Temporal Acoustic Point Holography Giorgos Christopoulos, Lei Gao, Diego Martinez Plasencia, Marta Betcke, Ryuji Hirayama, Sriram Subramanian
3D Shape Analysis
- DiffCAD: Weakly-supervised Probabilistic CAD Model Retrieval and Alignment From an RGB Image Daoyi Gao, David Rozenberszki, Stefan Leutenegger, Angela Dai
- 3Doodle: Compact Abstraction of Objects With 3D Strokes Changwoon Choi, Jaeah Lee, Jaesik Park, Young Min Kim
- DAE-Net: Deforming Auto-Encoder for Fine-grained Shape Co-segmentation Zhiqin Chen, Qimin Chen, Hang Zhou, Hao Zhang
- Split-and-Fit: Learning B-Reps via Structure-aware Voronoi Partitioning Yilin Liu, Jiale Chen, Shanshan Pan, Daniel Cohen-Or, Hao Zhang, Hui Huang
- Variational Feature Extraction in Scientific Visualization Nico Daßler, Tobias Günther
- Implicit Swept Volume SDF: Enabling Continuous Collision-free Trajectory Generation for Arbitrary Shapes Jingping Wang, Tingrui Zhang, Qixuan Zhang, Chuxiao Zeng, Jingyi Yu, Chao Xu, Lan Xu, Fei Gao
Appearance Models
- A Fully-correlated Anisotropic Micrograin BSDF Model Simon Lucas, Mickaël Ribardière, Romain Pacanowski, Pascal Barla
- From Microfacets to Participating Media: A Unified Theory of Light Transport With Stochastic GeometryBest Paper Dario Seyb, Eugene d'Eon, Benedikt Bitterli, Wojciech Jarosz
- A Free-space Diffraction BSDF Shlomi Steinberg, Ravi Ramamoorthi, Benedikt Bitterli, Arshiya Mollazainali, Eugene d'Eon, Matt Pharr
- A Realistic Multi-scale Surface-based Cloth Appearance Model Junqiu Zhu, Christophe Hery, Lukas Bode, Carlos Aliaga, Adrian Jarabo, Ling-Qi Yan, Matt Jen-Yuan Chiang
- One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patterns Arman Maesumi, Dylan Hu, Krishi Saripalli, Vladimir Kim, Matthew Fisher, Soeren Pirk, Daniel Ritchie
Cloth Simulation
- Neural-assisted Homogenization of Yarn-level Cloth Xudong Feng, Huamin Wang, Yin Yang, Weiwei Xu
- ContourCraft: Learning to Resolve Intersections in Neural Multi-garment Simulations Artur Grigorev, Giorgio Becherini, Michael Black, Otmar Hilliges, Bernhard Thomaszewski
- Progressive Dynamics for Cloth and Shell Animation Jiayi Eris Zhang, Doug James, Danny M. Kaufman
- Super-resolution Cloth Animation With Spatial and Temporal Coherence Jiawang Yu, Zhendong Wang
Dynamic Radiance Fields
- ST-4DGS: Spatial-Temporally Consistent 4D Gaussian Splatting for Efficient Dynamic Scene Rendering Deqi Li, Shi-Sheng Huang, Hua Huang, Zhiyuan Lu, Xinran Duan
- GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesis Boming Zhao, Yuan Li, Ziyu Sun, Lin Zeng, Yujun Shen, Rui Ma, Yinda Zhang, Hujun Bao, Zhaopeng Cui
- Factorized Motion Fields for Fast Sparse Input Dynamic View Synthesis Nagabhushan Somraj, Kapil Choudhary, Sai Harsha Mupparaju, Rajiv Soundararajan
- Modeling Ambient Scene Dynamics for Free-view Synthesis Meng-Li Shih, Jia-Bin Huang, Changil Kim, Rajvi Shah, Johannes Kopf, Chen Gao
- 4D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes Yuanxing Duan, Fangyin Wei, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen
- Controllable Neural Style Transfer for Dynamic Meshes Guilherme Gomes Haetinger, Jingwei Tang, Raphael Ortiz, Paul Kanyuk, Vinicius Azevedo
Generative 3D Geometry and Editing
- BrepGen: A B-rep Generative Diffusion Model With Structured Latent Geometry Xiang Xu, Joseph Lambourne, Pradeep Jayaraman, Zhengqing Wang, Karl Willis, Yasutaka Furukawa
- GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesis Dmitrii Petrov, Pradyumn Goyal, Vikas Thamizharasan, Vladimir Kim, Matheus Gadelha, Melinos Averkiou, Siddhartha Chaudhuri, Evangelos Kalogerakis
- CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D AssetsHonorable Mention Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, Jingyi Yu
- TIP-Editor: An Accurate 3D Editor Following Both Text-prompts and Image-prompts Jingyu Zhuang, Di Kang, Yan-Pei Cao, Guanbin Li, Liang Lin, Ying Shan
- Mesh Neural Cellular Automata Ehsan Pajouheshgar, Yitao Xu, Alexander Mordvintsev, Eyvind Niklasson, Tong Zhang, Sabine Süsstrunk
Perception, Image, Video
- Theory of Human Tetrachromatic Color Experience and PrintingHonorable Mention Jessica Lee, Nicholas Jennings, Varun Srivastava, Ren Ng
- ColorVideoVDP: A Visual Difference Predictor for Image, Video, and Display Distortions Rafal K. Mantiuk, Param Hanji, Maliha Ashraf, Yuta Asano, Alexandre Chapiro
- Versatile Vision Foundation Model for Image and Video Colorization Vukasin Bozic, Abdelaziz Djelouah, Yang Zhang, Radu Timofte, Markus Gross, Christopher Schroers
- Analogist: Out-of-the-box Visual In-context Learning With Image Diffusion Model Zheng Gu, Shiyuan Yang, Jing Liao, Jing Huo, Yang Gao
- Learning Images Across Scales Using Adversarial Training Krzysztof Wolski, Adarsh Djeacoumar, Alireza Javanmardi, Hans-Peter Seidel, Christian Theobalt, Guillaume Cordonnier, Karol Myszkowski, George Drettakis, Xingang Pan, Thomas Leimkühler
Rendering, Denoising & Path Guiding
- Practical Error Estimation for Denoised Monte Carlo Image Synthesis Arthur Firmino, Ravi Ramamoorthi, Jeppe Revall Frisvad, Henrik Wann Jensen
- Temporally Stable Metropolis Light Transport Denoising Using Recurrent Transformer Blocks Chuhao Chen, Yuze He, Tzu-mao Li
- Target-aware Image Denoising for Inverse Monte Carlo Rendering Jeongmin Gu, Jonghee Back, Sung-Eui Yoon, Bochang Moon
- Real-time Path Guiding Using Bounding Voxel Sampling Haolin Lu, Wesley Chang, Trevor Hedstrom, Tzu-Mao Li
- Specular Polynomials Zhimin Fan, Jie Guo, Yiming Wang, Tianyu Xiao, Hao Zhang, Chenxi Zhou, Zhenyu Chen, Pengpei Hong, Yanwen Guo, Ling-Qi Yan
- Spin-weighted Spherical Harmonics for Polarized Light Transport Shinyoung Yi, Donggun Kim, Jiwoong Na, Xin Tong, Min H. Kim
Simulating Deformation
- Position-based Nonlinear Gauss-Seidel for Quasistatic Hyperelasticity Yizhou Chen, Yushan Han, Jingyu Chen, Zhan Zhang, Alex McAdams, Joseph Teran
- Vertex Block Descent Anka H. Chen, Ziheng Liu, Yin Yang, Cem Yuksel
- Stabler Neo-Hookean Simulation: Absolute Eigenvalue Filtering for Projected Newton Honglin Chen, Hsueh-Ti Derek Liu, David I.W. Levin, Changxi Zheng, Alec Jacobson
- Simplicits: Mesh-free, Geometry-agnostic Elastic Simulation Vismay Modi, Nicholas Sharp, Or Perel, Shinjiro Sueda, David Levin
- Efficient Position-based Deformable Colon Modeling for Endoscopic Procedures Simulation Marcelo Martins, Lucas Morais, Rafael Torchelsen, Luciana Nedel, Anderson Maciel
- A Neural Network Model for Efficient Musculoskeletal-driven Skin Deformation Yushan Han, Yizhou Chen, Carmichael Ong, Jingyu Chen, Jennifer Hicks, Joseph Teran
Thursday, 1 August 2024
Controllable Image Generation and Completion
- Filter-Guided Diffusion for Controllable Image Generation Zeqi Gu, Ethan Yang, Abe Davis
- LOOSECONTROL: Lifting ControlNet for Generalized Depth Conditioning Shariq Bhat, Niloy Mitra, Peter Wonka
- Separate-and-Enhance: Compositional Finetuning for Text-to-image Diffusion Models Zhipeng Bao, Yijun Li, Krishna Kumar Singh, Yu-Xiong Wang, Martial Hebert
- RealFill: Reference-driven Generation for Authentic Image Completion Luming Tang, Nataniel Ruiz, Qinghao Chu, Yuanzhen Li, Aleksander Holynski, David E. Jacobs, Bharath Hariharan, Yael Pritch, Neal Wadhwa, Kfir Aberman, Michael Rubinstein
- Object-level Scene Deocclusion Zhengzhe Liu, Qing Liu, Chirui Chang, Jianming Zhang, Daniil Pakhomov, Haitian Zheng, Zhe Lin, Daniel Cohen-Or, Chi-Wing Fu
Simulation With Contact
- Primal-dual Non-smooth Friction for Rigid Body Animation Yi-Lu Chen, Mickaël Ly, Chris Wojtan
- Preconditioned Nonlinear Conjugate Gradient Method for Real-time Interior-point Hyperelasticity Xing Shen, Runyuan Cai, Mengxiao Bi, Tangjie Lv
- A Dynamic Duo of Finite Elements and Material Points Xuan Li, Minchen Li, Xuchen Han, Huamin Wang, Yin Yang, Chenfanfu Jiang
- Contact Detection Between Curved Fibres: High Order Makes a Difference Octave Crespel, Emile Hohnadel, Thibaut Metivet, Florence Bertails-Descoubes
Spatial Data Structures
- fVDB : A Deep-learning Framework for Sparse, Large Scale, and High Performance Spatial Intelligence Francis Williams, Jiahui Huang, Jonathan Swartz, Gergely Klar, Vijay Thakkar, Matthew Cong, Xuanchi Ren, Ruilong Li, Clement Fuji Tsang, Sanja Fidler, Eftychios Sifakis, Ken Museth
- Neural Bounding Stephanie Wenxin Liu, Michael Fischer, Paul D. Yoo, Tobias Ritschel
- N-BVH: Neural Ray Queries With Bounding Volume Hierarchies Philippe Weier, Alexander Rath, Élie Michel, Iliyan Georgiev, Philipp Slusallek, Tamy Boubekeur
- ReFiNe: Recursive Field Networks for Cross-modal Multi-scene Representation Sergey Zakharov, Katherine Liu, Adrien Gaidon, Rares Ambrus
- Neural Gaussian Scale-space Fields Felix Mujkanovic, Ntumba Elie Nsampi, Christian Theobalt, Hans-Peter Seidel, Thomas Leimkühler
Character Animation: 2D, 3D, Robot
- Semantic Gesticulator: Semantics-aware Co-speech Gesture Synthesis Zeyi Zhang, Tenglong Ao, Yuyao Zhang, Qingzhe Gao, Chuan Lin, Baoquan Chen, Libin Liu
- Text-guided Synthesis of Crowd Animation Xuebo Ji, Zherong Pan, Xifeng Gao, Jia Pan
- Interactive Design of Stylized Walking Gaits for Robotic Characters Michael A. Hopkins, Georg Wiedebach, Kyle Cesare, Jared Bishop, Espen Knoop, Moritz Bächer
- Soft Pneumatic Actuator Design Using Differentiable Simulation Arvi Gjoka, Espen Knoop, Moritz Bächer, Denis Zorin, Daniele Panozzo
- SMEAR: Stylized Motion Exaggeration With ARt-direction Jean Basset, Pierre Bénard, Pascal Barla
Computational Cameras and Displays
- Tele-Aloha: A Telepresence System With Low-budget and High-authenticity Using Sparse RGB Cameras Hanzhang Tu, Ruizhi Shao, Xue Dong, Shunyuan Zheng, Hao Zhang, Lili Chen, Meili Wang, Wenyu Li, Siyan Ma, Shengping Zhang, Boyao Zhou, Yebin Liu
- Split-Aperture 2-in-1 Computational Cameras Zheng Shi, Ilya Chugunov, Mario Bijelic, Geoffroi Côté, Jiwoon Yeom, Qiang Fu, Hadi Amata, Wolfgang Heidrich, Felix Heide
- Aperture-aware Lens Design Arjun Teh, Ioannis Gkioulekas, Matthew O'Toole
- Scale-invariant Monocular Depth Estimation via SSI Depth S. Mahdi H. Miangoleh, Mahesh Reddy, Yağız Aksoy
- Deep Hybrid Camera Deblurring for Smartphone Cameras Jaesung Rim, Junyong Lee, Heemin Yang, Sunghyun Cho
- Self-supervised Video Defocus Deblurring With Atlas Learning Lingyan Ruan, Mojtaba Bemana, Krzysztof Wolski, Martin Bálint, Hans-Peter Seidel, Karol Myszkowski, Bin Chen
Geometry: Editing and Deformation
- Biharmonic Coordinates and Their Derivatives for Triangular 3D Cages Jean-Marc THIERY, Elie Michel, Jiong Chen
- Curvature-driven Conformal Deformations Etienne Corman
- Repulsive ShellsBest Paper Josua Sassen, Henrik Schumacher, Martin Rumpf, Keenan Crane
- Semantic Shape Editing With Parametric Implicit Templates Uday Kusupati, Mathieu Gaillard, Jean-Marc Thiery, Adrien Kaiser
- A Unified Differentiable Boolean Operator With Fuzzy Logic Hsueh-Ti Derek Liu, Maneesh Agrawala, Cem Yuksel, Tim Omernick, Vinith Misra, Stefano Corazza, Morgan McGuire, Victor Zordan
- CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Hao Zhang, Chi-Wing Fu
Video Generation
- Motion-I2V: Consistent and Controllable Image-to-video Generation With Explicit Motion Modeling Xiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian, Dasong Li, Yi Zhang, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, Hongsheng Li
- I2V-Adapter: A General Image-to-Video Adapter for Diffusion Models Xun Guo, Mingwu Zheng, Liang Hou, Yuan Gao, Yufan Deng, Pengfei Wan, Di Zhang, Yufan Liu, Weiming Hu, Zhengjun Zha, Haibin Huang, Chongyang Ma
- Direct-a-Video: Customized Video Generation With User-directed Camera Movement and Object Motion Shiyuan Yang, Liang Hou, Haibin Huang, Chongyang Ma, Pengfei Wan, DI Zhang, Xiaodong Chen, Jing Liao
- MotionCtrl: A Unified and Flexible Motion Controller for Video Generation Zhouxia Wang, Ziyang Yuan, Xintao Wang, Yaowei Li, Tianshui Chen, Menghan Xia, Ping Luo, Ying Shan
- X-Portrait: Expressive Portrait Animation With Hierarchical Motion Attention You Xie, Hongyi Xu, Guoxian Song, Chao Wang, Yichun Shi, Linjie Luo
Character Control
- Categorical Codebook Matching for Embodied Character Controllers Sebastian Starke, Paul Starke, Taku Komura, Yuting Ye
- Interactive Character Control With Auto-regressive Motion Diffusion Models Yi Shi, Jingbo Wang, Xuekun Jiang, Bingkun Lin, Bo Dai, Xue Bin Peng
- MoConVQ: Unified Physics-based Motion Control via Scalable Discrete Representations Heyuan Yao, Zhenhua Song, Yuyang Zhou, Tenglong Ao, Baoquan Chen, Libin Liu
- SuperPADL: Scaling Language-directed Physics-based Control With Progressive Supervised Distillation Jordan B. Juravsky, Yunrong Guo, Sanja Fidler, Xue Bin Peng
- Strategy and Skill Learning for Physics-based Table Tennis Animation Jiashun Wang, Jungdam Won, Jessica Hodgins
Procedural Geometry
- Terrain Amplification Using Multi Scale Erosion Hugo Schott, Eric Galin, Eric Guérin, Axel Paris, Adrien Peytavie
- Interactive Invigoration: Volumetric Modeling of Trees With Strands Bosheng Li, Nikolas Schwarz, Wojtek Palubicki, Soeren Pirk, Bedrich Benes
- Surface-filling Curve Flows via Implicit Medial Axes Yuta Noma, Silvia Sellán, Nicholas Sharp, Karan Singh, Alec Jacobson
- Recompose Grammars for Procedural Architecture Niklaus Houska, Cheryl Lau, Matthias Specht
Radiance Field Processing
- A Construct-optimize Approach to Sparse View Synthesis Without Camera Pose Kaiwen Jiang, Yang Fu, Mukund Varma T, Yash Belhe, Xiaolong Wang, Hao Su, Ravi Ramamoorthi
- Bilateral Guided Radiance Field ProcessingHonorable Mention Yuehao Wang, Chaoyi Wang, Bingchen Gong, Tianfan Xue
- Rip-NeRF: Anti-aliasing Radiance Fields With Ripmap-encoded Platonic Solids Junchen Liu, Wenbo Hu, Zhuo Yang, Jianteng Chen, Guoliang Wang, Xiaoxue Chen, Yantong Cai, Huan-ang Gao, Hao Zhao
- N-Dimensional Gaussians for Fitting of High Dimensional Functions Stavros Diolatzis, Tobias Zirr, Alexander Kuznetsov, Georgios Kopanas, Anton Kaplanyan
- Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-based View Synthesis Christian Reiser, Stephan Garbin, Pratul Srinivasan, Dor Verbin, Richard Szeliski, Ben Mildenhall, Jonathan Barron, Peter Hedman, Andreas Geiger
- TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstruction Jia Li, Beibei Wang, Lu Wang, Lei Zhang
Sound, Light, Radiofrequency
- Cricket: A Self-powered Chirping Pixel Shree Nayar, Jeremy Klotz, Nikhil Nanda, Mikhail Fridberg
- AONeuS: A Neural Rendering Framework for Acoustic-optical Sensor Fusion Mohamad Qadri, Kevin Zhang, Akshay Hinduja, Michael Kaess, Adithya Pediredla, Christopher Metzler
- DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks Xutong Jin, Chenxi Xu, Ruohan Gao, Jiajun Wu, Guoping Wang, Sheng Li
- Accelerating Saccadic Response Through Spatial and Temporal Cross-modal Misalignments Daniel Jiménez Navarro, Xi Peng, Yunxiang Zhang, Karol Myszkowski, Hans-Peter Seidel, Qi Sun, Ana Serrano
- Radar Fields: Frequency-space Neural Scene Representations for FMCW Radar David Borts, Erich Liang, Jipeng Sun, Tim Broedermann, David Brueggemann, Christos Sakaridis, Luc Van Gool, Andrea Ramazzina, Edoardo Palladin, Stefanie Walz, Mario Bijelic, Felix Heide
Art, illusion, Fabrication
- Diffusion Illusions: Hiding Images in Plain Sight Ryan Burgert, Xiang Li, Abe Leite, Kanchana Ranasinghe, Michael Ryoo
- Cross-image Attention for Zero-shot Appearance Transfer Yuval Alaluf, Daniel Garibi, Or Patashnik, Hadar Averbuch-Elor, Daniel Cohen-Or
- Computational Illusion Knitting Amy Zhu, Yuxuan Mei, Benjamin Jones, Zachary Tatlock, Adriana Schulz
- Generative Escher Meshes Noam Aigerman, Thibault Groueix
- Fabricable 3D Wire Art Kenji Tojo, Ariel Shamir, Bernd Bickel, Nobuyuki Umetani
- Creating LEGO Figurines From Single Images Jiahao Ge, Mingjun Zhou, Wenrui Bao, Hao Xu, Chi-Wing Fu
