Publications

2024

  • [1]
    AmeliaTF: A Large Model and Dataset for Airport Surface Movement Forecasting.
    By Navarro, I., Ortega, P., Patrikar, J., Wang, H., Ye, Z., Park, J.H., Oh, J. and Scherer, S.
    In 2024 AIAA Aviation Forum and ASCEND, 2024.
  • [2]
    SafeShift: Safety-Informed Distribution Shifts for Robust Trajectory Prediction in Autonomous Driving.
    By Stoler, B., Navarro, I., Jana, M., Hwang, S., Francis, J. and Oh, J.
    In 2024 IEEE Intelligent Vehicles Symposium (IV), , pp. 1179–1186, , 2024.
  • [3]
    CoFRIDA: Self-Supervised Fine-Tuning for Human-Robot Co-Painting.
    By Schaldenbrand, P., Parmar, G., Zhu, J.-Y., McCann, J. and Oh, J.
    In IEEE International Conference on Robotics and Automation (ICRA), 2024.
  • [4]
    POE: Acoustic Soft Robotic Proprioception for Omnidirectional End-effectors.
    By Yoo, U., Ichnowski, J. and Oh, J.
    In IEEE International Conference on Robotics and Automation (ICRA), 2024.
  • [5]
    MOE-Hair: Toward Soft and Compliant Contact-rich Hair Manipulation and Care.
    By Yoo, U., Dennler, N., Mataric, M., Nikolaidis, S., \textbfJean Oh and Ichnowski, J.
    In ACM/IEEE International Conference on Human-Robot Interaction (HRI’24), 2024.
  • [6]
    Complementary Random Masking for RGB-Thermal Semantic Segmentation.
    By Shin, U., Lee, K., Kweon, I.S. and Oh, J.
    In IEEE International Conference on Robotics and Automation (ICRA), 2024.
  • [7]
    SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generation.
    By Liu, Z., Schaldenbrand, P., Okogwu, B., Yun, Y., Hundt, A., Kim, J. and Oh, J.
    In CVPR, 2024.
  • [8]
    Automating Design Iteration for Dexterous Anthropomorphic Soft Robotic Hands.
    By Mannam, P., Liu, X., Zhao, D., Oh, J. and Pollard, N.S.
    In IEEE 7th International Conference on Soft Robotics (RoboSoft), 2024.
  • [9]
    SoRTS: Learned Tree Search for Long Horizon Social Robot Navigation.
    By Navarro, I., Patrikar, J., Dantas, J.P.A., Baijal, R., Higgins, I., Scherer, S. and Oh, J.
    In IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3759–3766, 2024.

    • 2023

  • [1]
    Designing anthropomorphic soft hands through interaction.
    By Mannam, P., Shaw, K., Bauer, D., Oh, J., Pathak, D. and Pollard, N.
    In 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids), , pp. 1–8, , 2023.
  • [2]
    EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting.
    By Bae, I., Oh, J. and Jeon, H.-G.
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), , pp. 10017–10029, , 2023.
  • [3]
    T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Prediction.
    By Stoler, B., Jana, M., Hwang, S. and Oh, J.
    In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
  • [4]
    Core Challenges of Social Navigation: A Survey.
    By Mavrogiannis, C., Trautman, P., Steinfeld, A., Zhao, D., Wang, A., Baldini, F. and Oh, J.
    In ACM Transactions in Human-Robot Interaction (THRI), 2023.
  • [5]
    FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environment.
    By Schaldenbrand, P., McCann, J. and Oh, J.
    In IEEE International Conference on Robotics and Automation (ICRA), 2023.
  • [6]
    Follow The Rules: Online Signal Temporal Logic Tree Search for Guided Imitation Learning in Stochastic Domains.
    By Aloor, J.J., Patrikar, J., Kapoor, P., Oh, J. and Scherer, S.
    In IEEE International Conference on Robotics and Automation (ICRA), 2023.
  • [7]
    Robot Synesthesia: A Sound and Semantics Guided AI Painter.
    By Misra, V., Schaldenbrand, P. and Oh, J.
    In The AAAI-23 Workshop on Creative AI Across Modalities, 2023.
  • [8]
    Culturally-Aware Stable Diffusion: Supporting Cultural Representation in Text-to-Image Synthesis.
    By Liu, Z., Shin, Y., Okogwu, B.-C., Yun, Y., Schaldenbrand, P., Kim, J. and Oh, J.
    In The AAAI-23 Workshop on Creative AI Across Modalities, 2023.

    • 2022

  • [1]
    Challenges in Close-Proximity Safe and Seamless Operation of Manned and Unmanned Aircraft in Shared Airspace.
    By Patrikar, J., Dantas, J., Ghosh, S., Kapoor, P., Higgins, I., Aloor, J.J., Navarro, I., Sun, J., Stoler, B., Hamidi, M. and others.
    In arXiv preprint arXiv:2211.06932, 2022.
  • [2]
    Core Challenges in Embodied Vision-Language Planning.
    By Francis, J., Kitamura, N., Labelle, F., Lu, X., Navarro, I. and Oh, J.
    In Journal of Artificial Intelligence Research (JAIR), vol. 74, pp. 459–515, 2022.
  • [3]
    Anytime 3D Object Reconstruction using Multi-modal Variational Autoencoder.
    By Yu, H. and Oh, J.
    In IEEE Robotics and Automation Letters (RA-L; ICRA), vol. 7, no. 2, pp. 2162–2169, Apr. 2022.
  • [4]
    Predicting Like A Pilot: Dataset and Method to Predict Socially-Aware Aircraft Trajectories in Non-Towered Terminal Airspace.
    By Patrikar, J., Moon, B., Oh, J. and Scherer, S.
    In IEEE International Conference on Robotics and Automation (ICRA), 2022.
  • [5]
    Autonomous Exploration Development Environment and the Planning Algorithms.
    By Cao, C., Zhu, H., Yang, F., Xia, Y., Choset, H., Oh, J. and Zhang, J.
    In IEEE International Conference on Robotics and Automation (ICRA), 2022.
  • [6]
    FAR Planner: Fast, Attemptable Route Planner using Dynamic Visibility Update.
    By Yang, F., Cao, C., Zhu, H., Oh, J. and Zhang, J.
    In the 35th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.
  • [7]
    Translating Robot Skills: Learning Unsupervised Skill Correspondences Across Robots.
    By Shankar, T., Lin, Y., Rajeswaran, A., Kumar, V., Anderson, S. and Oh, J.
    In Proceedings of the 39th International Conference on Machine Learning (ICML), vol. 162, , , pp. 19626–19644, , 2022.
  • [8]
    StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translation.
    By Schaldenbrand, P., Liu, Z. and Oh, J.
    In proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI), 2022.
  • [9]
    Social-PatteRNN: Socially-Aware Trajectory Prediction Guided by Motion Patterns.
    By Navarro, I. and Oh, J.
    In the 35th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.
  • [10]
    RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learning.
    By Yao, X., Zhang, J. and Oh, J.
    In the 35th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.
  • [11]
    Towards Real-Time Text2Video via CLIP-Guided, Pixel-Level Optimization.
    By Schaldenbrand, P., Liu, Z. and Oh, J.
    In Neural Information Processing Systems (NeurIPS) Workshop on Machine Learning for Creativity and Design, 2022.

    • 2021

  • [1]
    A Large-sacle Virtual Dataset and Egocentric Localization for Disaster Responses.
    By Jeon, H.-G., Im, S., Lee, B.-U., Choi, D.-G., Oh, J., Kweon, I.S. and Hebert, M.
    In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.
  • [2]
    Using Perception Cues for Context-Aware Navigation in Dynamic Outdoor Environments.
    By Wigness, M., Rogers, J., Mertz, C., Navarro-Serment, L. and Oh, J.
    In Journal of Field Robotics (JFR), Special Edition on Human-Robot Teaming, 2021.
  • [3]
    An Intelligence Architecture for Grounded Language Communication with Field Robots.
    By Howard, T.M., Stump, E., Fink, J., Arkin, J., Paul, R., Park, D., Roy, S., Barber, D., Bendell, R., Schmeckpeper, K., Tian, J., Oh, J., Wigness, M., Quang, L., Rothrock, B., Nash, J., Walter, M.R., Patel, D., Jentsch, F. and N. Roy, and.
    In Journal of Field Robotics (JFR), Special Edition on Human-Robot Teaming, 2021.
  • [4]
    Language Understanding for Field and Service Robots in a Priori Unknown Environments.
    By Walter, M.R., Patki, S., Fahnestock, E., Duvallet, F., Hemachandra, S., Roy, N., Howard, T.M. and Oh, J.
    In Journal of Field Robotics (JFR), Special Edition on Human-Robot Teaming, 2021.
  • [5]
    Content Masked Loss: Human-Like Brush Stroke Planning in a Reinforcement Learning Painting Agent.
    By Schaldenbrand, P. and Oh, J.
    In Proc. of AAAI Conference on Artificial Intelligence (AAAI), 2021.
  • [6]
    Anchor Distance for 3D Multi-Object Distance Estimation from 2D Single Shot.
    By Yu, H. and Oh, J.
    In IEEE Robotics and Automation Letters (RA-L), 2021.
  • [7]
    StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Synthesis.
    By Schaldenbrand, P., Liu, Z. and Oh, J.
    In Neural Information Processing Systems (NeurIPS) Workshop on Machine Learning and Design, 2021.

    • 2020

  • [1]
    A Generative Approach for Socially Compliant Navigation.
    By Tsai, T.-E. and Oh, J.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2020.
  • [2]
    Learning Shape-based Representation for Visual Localization in Extremely Changing Conditions.
    By Jeon, H.G., Im, S., Oh, J. and Hebert, M.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2020.
  • [3]
    CNN-based Simultaneous Dehazing and Depth Estimation.
    By Lee, B.-U., Lee, K., Oh, J. and Kweon, I.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2020.
  • [4]
    Noticing Motion Patterns: Temporal CNN with a Novel Convolution Operator for Human Trajectory Prediction.
    By Zhao, D. and Oh, J.
    In IEEE Robotics and Automation Letters (RA-L), Special Issue on Long-Term Human Motion Prediction, 2020.
  • [5]
    Artistic Style in Robotic Painting; a Machine Learning Approach to Learning Brushstroke from Human Artists.
    By Bidgoli, A., Guevara, M.L.D., Hsiung, C., Oh, J. and Kang, E.
    In The 29th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), 2020.
  • [6]
    Modular Pretraining for Vision Language Navigation.
    By Labelle, F., Lu, X., Kitamura, N. and Oh, J.
    In Embodied Vision, Actions & Language (EVAL) Workshop at European Conference on Computer Vision (ECCV), 2020.

    • 2019

  • [1]
    Compositional Neural Module Networks for Detailed Image Captioning.
    By Tian, J. and Oh, J.
    In Proc. of International Joint Conference on Artificial Intelligence (IJCAI), 2019.
  • [2]
    Report from Dagstuhl Seminar 19021: Joint Processing of Language and Visual Data for Better Automated Understanding.
    By al., M.F.M. et.
    Schloss Dagstuhl, Germany
    2019
  • [3]
    A 20-Year Community Roadmap for Artificial Intelligence Research in the US.
    By al., Y.G. et.
    Computing Community Consortium (CCC), Computing Research Association (CRA)
    2019
  • [4]
    Explainable Semantic Mapping for First Responders.
    By Oh, J., Hebert, M., Jeon, H.-G., Dai, C. and Song, Y.
    In Artificial Intelligence for Humanitarian Assistance and Disaster Response Workshop at the Conference on Neural Information Processing Systems (NeurIPS), 2019.
  • [5]
    Autonomous Human-Aware Navigation in Dense Crowds.
    By Yao, X., Zhang, J. and Oh, J.
    In Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019.
  • [6]
    Following Social Groups: Socially-Compliant Autonomous Navigation in Dense Crowds.
    By Yao, X., Zhang, J. and Oh, J.
    In Cognitive Vehicles Workshop at IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019.

    • 2018

  • [1]
    Social Attention: Modeling Attention in Human Crowds.
    By Vemula, A., Mülling, K. and Oh, J.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2018.
  • [2]
    A Multimodal Dialogue System for Conversational Image Editing.
    By Lin, T.-H., Bui, T., Kim, D.S. and Oh, J.
    In The Second Workshop on Conversational AI at the Thirty-second Conference on Neural Information Processing Systems (NeurIPS), 2018.

    • 2017

  • [1]
    Modeling Cooperative Navigation in Dense Human Crowds.
    By Vemula, A., Muelling, K. and Oh, J.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2017.
  • [2]
    Vision-Language Fusion for Object Recognition.
    By Shiang, S.-R., Rosenthal, S., Gershman, A., Carbonell, J. and Oh, J.
    In Proc. of AAAI Conference on Artificial Intelligence (AAAI), 2017.
  • [3]
    Assistive Technology for Geriatric Population.
    By Oh-Park, M. and Oh, J.
    In Geriatric Rehabilitation,
    Elsevier, 2017
  • [4]
    A Generalized Model for Multimodal Perception.
    By Shiang, S.-R., Gershman, A. and Oh, J.
    In AAAI Fall Symposium Series, 2017.
  • [5]
    Answer-Aware Attention on Grounded Question Answering in Images.
    By Hu, J., Fan, D., Yao, S. and Oh, J.
    In AAAI Fall Symposium on Natural Communication for Human Robot Collaboration, 2017.

    • 2016

  • [1]
    Learning Qualitative Spatial Relations for Robotic Navigation.
    By Boularias, A., Duvallet, F., Oh, J. and Stentz, A.
    In Proc. of International Joint Conference on Artificial Intelligence (IJCAI), 2016.
  • [2]
    Path Planning in Dynamic Environments with Adaptive Dimensionality.
    By Vemula, A., Muelling, K. and Oh, J.
    In International Symposium on Combinatorial Search (SoCS), 2016.
  • [3]
    Learning Lexical Entries for Robotic Commands using Crowdsourcing.
    By Hu, J., Oh, J. and Gershman, A.
    In Proc. of AAAI Conference on Human Computation (HCOMP), 2016.
  • [4]
    Attention-based multimodal neural machine translation.
    By Huang, P.-Y., Liu, F., Shiang, S.-R., Oh, J. and Dyer, C.
    In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, vol. 2, , , pp. 639–645, , 2016.
  • [5]
    Integrated Intelligence for Human-Robot Teams.
    By Oh, J., Zhu, M., Park, S., Howard, T.M., Walter, M.R., Barber, D., Romero, O., Suppe, A., Navarro-Serment, L., Duvallet, F., Boularias, A., Vinokurov, J., Keegan, T., Dean, R., Lennon, C., Bodt, B., Childers, M., Shi, J., Daniilidis, K., Roy, N., Lebiere, C., Hebert, M. and Stentz, A.
    In International Symposium on Experimental Robotics (ISER), 2016.

    • 2015

  • [1]
    Inferring door locations from a teammate’s trajectory in stealth human-robot team operations.
    By Oh, J., Navarro-Serment, L.E., Suppe, A., Stentz, A. and Hebert, M.
    In Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015.
  • [2]
    Toward Mobile Robots Reasoning Like Humans.
    By Oh, J., Suppe, A., Duvallet, F., Boularias, A., Vinokurov, J., Navarro-Serment, L., Romero, O., Dean, R., Lebiere, C., Hebert, M. and Stentz, A.
    In Proc. of AAAI Conference on Artificial Intelligence (AAAI), 2015.
  • [3]
    Learning to Ground Spatial Relations for Outdoor Robot Navigation.
    By Boularias, A., Duvallet, F., Oh, J. and Stentz, A.
    In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2015.

    • 2014

  • [1]
    Probabilistic Plan Recognition for Proactive Assistant Agents.
    By Oh, J., Meneguzzi, F. and Sycara, K.
    Elsevier, 2014, pp. pp. 275–288
  • [2]
    Inferring Maps and Behaviors from Natural Language Instructions.
    By Duvallet, F., Walter, M.R., Howard, T., Hemachandra, S., Oh, J., Teller, S., Roy, N. and Stentz, A.
    In International Symposium on Experimental Robotics (ISER), 2014.
  • [3]
    Ontology-based Cognitive System for Contextual Reasoning in Robot Architectures.
    By Oltramari, A., Vinokurov, Y., C. Lebiere, J.O. and Stentz, A.
    In Proc. of AAAI Spring Symposium on Knowledge Representation and Reasoning in Robotics, 2014.

    • 2013

  • [1]
    Prognostic normative reasoning.
    By Oh, J., Meneguzzi, F., Sycara, K.P. and Norman, T.J.
    In Engineering Applications of Artificial Intelligence, vol. 26, no. 2, pp. 863–872, 2013.
  • [2]
    A Hybrid Cognitive System for Spatial Reasoning in a Robotics Framework.
    By Oltramari, A., Vinokurov, Y., Lebiere, C., Oh, J. and Stentz, A.
    In Proc. of the Second Annual Conference on Advances in Cognitive Systems, 2013.
  • [3]
    Enhancing robot perception using human teammates.
    By Oh, J., Suppe, A., Stentz, A. and Hebert, M.
    In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), , pp. 1147–1148, , 2013.

    • 2012

  • [1]
    The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates.
    By Ososky, S., Schuster, D., Jentsch, F., Fiore, S., Shumaker, R., Lebiere, C., Kurup, U., Oh, J. and Stentz, A.
    In SPIE Defense, Security, and Sensing, 2012.
  • [2]
    A cognitive architecture for emergency response.
    By Meneguzzi, F., Oh, J., Chakraborty, N., Sycara, K.P., Mehrotra, S., Tittle, J. and Lewis, M.
    In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), , pp. 1161–1162, , 2012.

    • 2011

  • [1]
    An Agent Architecture for Prognostic Reasoning Assistance.
    By Oh, J., Meneguzzi, F., Sycara, K. and Norman, T.
    In Proc. of International Joint Conference on Artificial Intelligence (IJCAI), , pp. 2513–2518, , 2011.
  • [2]
    Prognostic normative reasoning in coalition planning.
    By Oh, J., Meneguzzi, F., Sycara, K.P. and Norman, T.J.
    In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), , pp. 1233–1234, , 2011.
  • [3]
    Probabilistic plan recognition for intelligent information agents.
    By Oh, J., Meneguzzi, F. and Sycara, K.
    In Proc. of the Third International Conference on Agents and Artificial Intelligence, 2011.
  • [4]
    Introduction to Prognostic Normative Reasoning.
    By Oh, J., Meneguzzi, F., Sycara, K.P. and Norman, T.J.
    In Proc. of AAMAS Workshops, , pp. 503–504, , 2011.
  • [5]
    Reports of the AAAI 2010 Fall Symposia.
    By al., R.A. et.
    In AI Magazine, vol. 32, no. 1, pp. 93–100, 2011.

    • 2010

  • [1]
    An agent architecture for intelligent information assistance.
    By Oh, J., Meneguzzi, F., Sycara, K. and Norman, T.J.
    In Proc. of the Fourth Conference of the International Technology Alliance, 2010.
  • [2]
    Intelligent information assistance for coalition operations.
    By Meneguzzi, F., Oh, J. and Sycara, K.
    In Proc. of the Sixth International Conference on Knowledge Systems for Coalition Operations, 2010.
  • [3]
    Agent Support for Policy-Driven Mission Planning Under Constraints.
    By Sensoy, M., Masato, D., Norman, T.J., Kollingbaum, M.J., Burnett, C., Sycara, K. and Oh, J.
    In AAAI Fall Symposium: Proactive Assistant Agents, 2010.

    • 2008

  • [1]
    A few good agents: Multi-agent social learning.
    By Oh, J. and Smith, S.F.
    In Proc. of the Seventh International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), , pp. 339–346, , 2008.

    • 2006

  • [1]
    Learning from Main Streets: A machine learning approach identifying neighborhood commercial districts.
    By Oh, J., Hwang, J.E., Smith, S.F. and Koile, K.
    In Innovations in Design & Decision Support Systems in Architecture and Urban Planning, Part 4,
    Springer Netherlands, 2006, pp. pp. 325–340
  • [2]
    Scheduling with uncertain resources: Search for a near-optimal solution.
    By Fink, E., Jennings, P.M., Bardak, U., Oh, J., Smith, S.F. and Carbonell, J.G.
    In Proc. of the IEEE International Conference on Systems, Man, and Cybernetics, , pp. 137–144, , 2006.
  • [3]
    Agent technologies for post-disaster urban planning.
    By Oh, J., J.E.Hwang and Smith, S.F.
    In AAMAS Workshop on Agent Technology for Disaster Management, 2006.

    • 2005

  • [1]
    Learning User Preferences in Distributed Calendar Scheduling.
    By Oh, J. and Smith, S.F.
    In Practice and Theory of Automated Timetabling V, vol. 3616, pp. 3–16, 2005.
  • [2]
    CMRadar: A personal assistant agent for calendar management.
    By Modi, P.J., Veloso, M., Smith, S.F. and Oh, J.
    In Agent Oriented Information Systems II, pp. 169–181, 2005.
  • [3]
    CMRadar: A personal assistant agent for calendar management.
    By Modi, P.J., Veloso, M., Smith, S.F. and Oh, J.
    In Proc. of the Nineteenth National Conference on Artificial Intelligence (AAAI), , pp. 1020–1021, , 2005.
  • [4]
    Calendar Assistants that Learn Preferences.
    By Oh, J. and Smith, S.F.
    In Persistent Assistants: Living and Working with AI, AAAI Spring Symposium, 2005.