About Me

I am currently a postdoctoral researcher at Cyber Physical Systems (CPS) group at University of Oxford under supervisions of Profs. Niki Trigoni and Andrew Markham. My research is centered on multi-modal sensing for localization and cross-domain generalization, especially for building robust perception in real-world settings.

I obtained my D.Phil. (PhD) in Computer Science at the University of Oxford, co-supervised by Profs. Niki Trigoni and Andrew Markham in CPS group. My study was generously supported by Global Korea Scholarship (GKS) Program and ACE-OPS grant. Prior to my D.Phil., I worked as a research assosiate supervised by Prof. Yong-Guk Kim at Sejong University, South Korea, where I completed my master's and undergraduate courses in Computer Science.

Research Interests

My research aims to advance multi-modal and multi-view sensing with diverse physical sensors, including RGB-D cameras, LiDAR, mmWave radar, event cameras, etc. A key challenge in real-world settings is achieving reliable long-term localization of these sensors in a shared reference space, enabling accurate multi-view fusion while leveraging the unique capabilities of each modality.

Beyond localization, I am interested in how foundation models can develop reasoning abilities across modalities—understanding the complementary strengths of each sensor type and dynamically selecting and combining the most informative modalities for a given task. This supports robust, context-aware performance on downstream applications, including detection, tracking, re-identification, anomaly detection, etc.

Ultimately, my work seeks to bridge physical sensing with adaptive multi-modal learning, building perception systems that are accurate, resilient, and capable of operating reliably in complex real-world environments.

News

• [Jun. 2025] Our paper DiffRefine on generative cross-domain detection in 3D got accepted into ICCV 2025 for spotlight presentation!
• [Mar. 2025] Our paper WildPose on multi-modal sensing dataset for deformable animals got accepted into Journal of Experimental Biology and selected as the cover of the issue!
• [Jan. 2025] Completed my thesis correction and obtained D.Phil. (PhD) status!
• [Jan. 2025] Our paper SoundLoc3D on sound source localization got accepted into WACV 2025 for oral presentation!
• [Oct. 2024] Started my role as a postdoctoral researcher in CPS group.
• [Oct. 2024] Successfully defended my D.Phil viva! (Internal Examiner: Prof. Christian Rupprecht at VGG, External Examiner: Prof. Dimitrios Kanoulas at UCL).
• [Sep. 2024] Our paper GroupExp-DA on Domain-Adaptive 3D Detection got accepted into NeurIPS 2024!
• [May. 2024] Our paper on stereo depth estimation with visual foundation models got accepted into ICRA 2024!
• [Mar. 2024] Our paper Spherical Mask on 3D instance segmentation got accepted into CVPR 2024!
• [Feb. 2024] Defended my Confirmation viva (Examiners: Profs. Ronald Clark and Alessandro Abate).
• [Jan. 2024] Our paper Sound3DVDet on sound source localization got accepted into WACV 2024!
• [Jul. 2023] Our paper on view synthesis with NeRF got accepted into NeurIPS 2023!
• [Jan. 2023] Our paper Sample, Crop, Track on self-supervised 3D object detection got accepted into ICRA 2023!
• [Aug. 2022] Our paper on monocular Night-time Depth Estimation got accepted into CORL 2023!
• [Mar. 2022] Our paper on monocular SLAM on UAV got accepted into IROS 2022!
• [Jan. 2022] Defended my Transfer of Status viva (Examiners: Profs. Alex Rogers and Alessandro Abate).
• [Oct. 2020] Started my D.Phil. (PhD) at the University of Oxford.
• [Aug. 2020] Concluded my research at Sejong University, South Korea. Plase see my exciting researches at Sejong on reinforcement learning and sensing with videos here!

Selected Publications

DiffRefine: Diffusion-based Proposal Specific Point Cloud Densification for Cross-Domain Object Detection

Sangyun Shin, Yuhang He, Xinyu Hou, Samuel Hodgson, Andrew Markham, Niki Trigoni

International Conference on Computer Vision (ICCV), 2025 (Spotlight)

[Paper] [Project] [Code to be released]

WildPose: a long-range 3D wildlife motion capture system

Naoya Muramatsu, Sangyun Shin, Qianyi Deng, Andrew Markham, Amir Patel

Journal of Experimental Biology, Volume 228, Issue 5 (Cover of the Issue)

[Paper] [Code] [Dataset]

SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera

Yuhang He, Sangyun Shin, Anoop Cherian, Niki Trigoni, Andrew Markham

Winter Conference on Applications of Computer Vision (WACV), 2025 (Oral)

[Paper]

Towards Learning Group-Equivariant Features for Domain Adaptive 3D Detection

Sangyun Shin, Yuhang He, Madhu Vankadari, Ta-Ying Cheng, Qian Xie, Andrew Markham, Niki Trigoni

Neural Information Processing Systems (NeurIPS), 2024

[Paper] [Code]

Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representation

Sangyun Shin, Kaichen Zhou, Madhu Vankadari, Andrew Markham, Niki Trigoni

Computer Vision and Pattern Recognition (CVPR), 2024

[Paper] [Code]

Sound3DVDet: 3D Sound Source Detection using Multiview Microphone Array and RGB Images

Yuhang He*, Sangyun Shin*, Anoop Cherian, Niki Trigoni, Andrew Markham (*=Equal Contribution)

Winter Conference on Applications of Computer Vision (WACV), 2025

[Paper] [Code]

Sample, crop, track: Self-supervised mobile 3d object detection for urban driving lidar

Sangyun Shin, Stuart Golodetz, Madhu Vankadari, Kaichen Zhou, Andrew Markham, Niki Trigoni

International Conference on Robotics and Automation (ICRA), 2023

[Paper]

Contact

Email: sangyun.shin@cs.ox.ac.uk

I’m open to opportunities, collaborations and research discussions. Feel free to reach out!