Multimodal Vision Research Laboratory

• Role: PI
• Funding Source: NVIDIA Corporation
• Duration: 2015 – 2015

Overview

Fast Graphical Processing Units (GPUs) are key enablers for current deep learning methods in computer vision. We are grateful to the NVIDIA corporation for supporting our research in this area. Currently we are using a donated Tesla K40c GPU to train models for several different tasks.

Related Publication(s)

1. Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR).
   bibtex

   ×Close

   Bibtex Entry for "Implicit Land Use Mapping Using Social Media Imagery"

   @inproceedings{greenwell2019implicit,
     annotation = {abstract,google_crossview,amazon,nvidia,remote_sensing,social_media},
     author = {Greenwell, Connor and Workman, Scott and Jacobs, Nathan},
     booktitle = {IEEE Applied Imagery and Pattern Recognition (AIPR)},
     title = {Implicit Land Use Mapping Using Social Media Imagery},
     year = {2019}
   }
   

2. Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
   bibtex | code

   ×Close

   Bibtex Entry for "Predicting Ground-Level Scene Layout from Aerial Imagery"

   @inproceedings{zhai2017layout,
     annotation = {google_crossview,localization,spotlight,nvidia,amazon,career,remote_sensing},
     author = {Zhai, Menghua and Bessinger, Zach and Workman, Scott and Jacobs, Nathan},
     booktitle = {{IEEE Conference on Computer Vision and Pattern Recognition (CVPR)}},
     code = {https://github.com/viibridges/crossnet},
     date-modified = {2020-03-31 16:54:39 -0400},
     pdf = {http://arxiv.org/pdf/1612.02709},
     thumbnail = {http://cs.uky.edu/%7ejacobs/thumbnails/predict_layout.jpg},
     title = {Predicting Ground-Level Scene Layout from Aerial Imagery},
     year = {2017}
   }
   

3. Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR).
   bibtex

   ×Close

   Bibtex Entry for "Crossview Convolutional Networks"

   @inproceedings{jacobs2016crossview,
     annotation = {google_crossview,amazon,nvidia,remote_sensing,abstract,social_media},
     author = {Jacobs, Nathan and Workman, Scott and Zhai, Menghua},
     booktitle = {IEEE Applied Imagery and Pattern Recognition (AIPR)},
     title = {Crossview Convolutional Networks},
     year = {2016}
   }
   

4. Bessinger Z, Stauffer C, Jacobs N. 2016. Who Goes There? Approaches to Mapping Facial Appearance Diversity. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL).
   bibtex

   ×Close

   Bibtex Entry for "Who Goes There? Approaches to Mapping Facial Appearance Diversity"

   @inproceedings{bessinger2016wgt,
     annotation = {dataset_wgt,geolookbook,geofaces,amazon,nvidia,social_media},
     author = {Bessinger, Zachary and Stauffer, Chris and Jacobs, Nathan},
     booktitle = {ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL)},
     title = {Who Goes There? Approaches to Mapping Facial Appearance Diversity},
     year = {2016}
   }
   

5. Bessinger Z, Jacobs N. 2016. Quantifying Curb Appeal. In: IEEE International Conference on Image Processing (ICIP).
   bibtex | website

   ×Close

   Bibtex Entry for "Quantifying Curb Appeal"

   @inproceedings{bessinger2016curbappeal,
     annotation = {nvidia},
     author = {Bessinger, Zachary and Jacobs, Nathan},
     booktitle = {{IEEE International Conference on Image Processing (ICIP)}},
     pdf = {http://cs.uky.edu/%7ezach/assets/papers/bessinger2016quantifying.pdf},
     project = {http://cs.uky.edu/%7ezach/publications/bessinger2016quantifying/},
     title = {Quantifying Curb Appeal},
     year = {2016}
   }
   

6. Workman S, Zhai M, Jacobs N. 2016. Horizon Lines in the Wild. In: British Machine Vision Conference (BMVC).
   bibtex | website | code

   ×Close

   Bibtex Entry for "Horizon Lines in the Wild"

   @inproceedings{workman2016hlw,
     annotation = {hlw,dataset_hlw,spotlight,waldo,nvidia,localization,calibration},
     author = {Workman, Scott and Zhai, Menghua and Jacobs, Nathan},
     booktitle = {British Machine Vision Conference (BMVC)},
     code = {https://github.com/scottworkman/deephorizon},
     pdf = {http://arxiv.org/abs/1604.02129},
     project = {http://mvrl.cs.uky.edu/datasets/hlw/},
     thumbnail = {http://mvrl.cs.uky.edu/thumbnails/hlw.jpg},
     title = {Horizon Lines in the Wild},
     year = {2016}
   }
   

7. Zhai M, Workman S, Jacobs N. 2016. Detecting Vanishing Points using Global Image Context in a Non-Manhattan World. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
   bibtex | website | code

   ×Close

   Bibtex Entry for "Detecting Vanishing Points using Global Image Context in a Non-Manhattan World"

   @inproceedings{zhai2016horizon,
     annotation = {spotlight,hlw,calibration,deeplearning,nvidia,contextualeyes},
     author = {Zhai, Menghua and Workman, Scott and Jacobs, Nathan},
     booktitle = {{IEEE Conference on Computer Vision and Pattern Recognition (CVPR)}},
     code = {https://github.com/viibridges/gc-horizon-detector},
     pdf = {http://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Zhai_Detecting_Vanishing_Points_CVPR_2016_paper.pdf},
     project = {http://cs.uky.edu/%7eted/research/fasthorizon/},
     thumbnail = {http://cs.uky.edu/%7ejacobs/thumbnails/horizon_sampling.jpg},
     title = {Detecting Vanishing Points using Global Image Context in a Non-Manhattan World},
     year = {2016}
   }
   

8. Salem T, Workman S, Zhai M, Jacobs N. 2016. Analyzing Human Appearance as a Cue for Dating Images. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–8.
   bibtex | website

   ×Close

   Bibtex Entry for "Analyzing Human Appearance as a Cue for Dating Images"

   @inproceedings{salem2016face2year,
     annotation = {dataset_face2year,geofaces,contextualeyes,nvidia,social_media},
     author = {Salem, Tawfiq and Workman, Scott and Zhai, Menghua and Jacobs, Nathan},
     booktitle = {{IEEE Winter Conference on Applications of Computer Vision (WACV)}},
     pages = {1--8},
     pdf = {http://cs.uky.edu/%7ejacobs/papers/salem2016face2year.pdf},
     project = {http://cs.uky.edu/%7esalem/face2year/},
     title = {Analyzing Human Appearance as a Cue for Dating Images},
     year = {2016}
   }
   

9. Mihail RP, Workman S, Bessinger Z, Jacobs N. 2016. Sky Segmentation in the Wild: An Empirical Study. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–6.
   bibtex | website

   ×Close

   Bibtex Entry for "Sky Segmentation in the Wild: An Empirical Study"

   @inproceedings{mihail2016sky,
     annotation = {contextualeyes,dataset_skyfinder,skyfinder,nvidia,timelapse},
     author = {Mihail, Radu Paul and Workman, Scott and Bessinger, Zach and Jacobs, Nathan},
     booktitle = {{IEEE Winter Conference on Applications of Computer Vision (WACV)}},
     pages = {1--6},
     pdf = {http://cs.uky.edu/%7ejacobs/papers/mihail2016skyfinder.pdf},
     project = {http://mypages.valdosta.edu/rpmihail/skyfinder/},
     title = {Sky Segmentation in the Wild: An Empirical Study},
     year = {2016}
   }
   

10. Baltenberger R, Zhai M, Greenwell C, Workman S, Jacobs N. 2016. A Fast Method for Estimating Transient Scene Properties. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–8.
    bibtex | website | code

    ×Close

    Bibtex Entry for "A Fast Method for Estimating Transient Scene Properties"

    @inproceedings{baltenberger2016transient,
      annotation = {contextualeyes,nvidia,timelapse,localization},
      author = {Baltenberger, Ryan and Zhai, Menghua and Greenwell, Connor and Workman, Scott and Jacobs, Nathan},
      booktitle = {{IEEE Winter Conference on Applications of Computer Vision (WACV)}},
      code = {https://github.com/UkyVision/deeptransient/},
      pages = {1--8},
      pdf = {http://cs.uky.edu/%7ejacobs/papers/baltenberger2016transient.pdf},
      project = {https://rbalten.github.io/transient/},
      title = {A Fast Method for Estimating Transient Scene Properties},
      year = {2016}
    }
    

11. Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9.
    bibtex | website | code

    ×Close

    Bibtex Entry for "Wide-Area Image Geolocalization with Aerial Reference Imagery"

    @inproceedings{workman2015localize,
      annotation = {spotlight,dataset_cvusa,waldo,nvidia,remote_sensing,social_media,localization},
      author = {Workman, Scott and Souvenir, Richard and Jacobs, Nathan},
      booktitle = {{IEEE International Conference on Computer Vision (ICCV)}},
      code = {https://github.com/scottworkman/deeplyfound},
      pages = {1--9},
      pdf = {http://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Workman_Wide-Area_Image_Geolocalization_ICCV_2015_paper.pdf},
      project = {http://cs.uky.edu/%7escott/research/deeplyfound/},
      thumbnail = {http://cs.uky.edu/%7ejacobs/thumbnails/crossview.jpg},
      title = {Wide-Area Image Geolocalization with Aerial Reference Imagery},
      year = {2015}
    }
    

Acknowledgements

We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Tesla K40 GPU used for this research.