Education

The University of Texas at Austin

Bachelor of Science, Computer Science ’18

Bachelor of Science, Electrical Engineering ’18

Honors Capstone Project: Deep Reinforcement Learning for Aerial Obstacle Avoidance using Monocular RGB Images
Selected Coursework: Show

  • Robot Learning (CS 395T)
  • Human Robot Interaction (EE 382V)
  • Artificial Intelligence (CS 343)
  • Neural Networks (CS 342)
  • Computer Vision (CS 378H)
  • Computer Graphics (CS 354)
  • Physical Simulation (CS 395T)
  • Operating Systems (CS 439)
  • Signal Processing (EE 313)
  • Computer Architecture (EE 460N)
  • Embedded Systems (EE 445L)

 

Work Experience

X — Software Engineer, Robotics [July 2018 – Present]

Working on perception team. Mountain View, California.
 

X — Software Engineering Intern, Robotics [May 2017 – Aug 2017]

Worked on perception for human-robot interaction. Mountain View, California.
 

Google — Software Engineering Intern, Project Tango [May 2016 – Aug 2016]

Worked on experimental augmented reality. Created environmental lighting system allowing more photorealistic lighting and reflections in augmented reality for Tango SDK. Published Google Developer Blog post with tutorial for usage. Also experimented with video stabilization. Experience in computer vision, computer graphics, and computational photography. Worked with C++, Unity, and Java. Mountain View, California.
 

Google — Software Engineering Intern, Chrome for Android [May 2015 – Aug 2015]

Served as an intern on tools and infrastructure for Chrome for Android. All code is open source as part of Chromium. Wrote test infrastructure for sign-in authentication test. Also created parametrizable testing framework. All my code is open source as part of Chromium! Worked with Java, Python, and C++. Mountain View, California.
 

Accordion Health — Software Engineer [Aug 2014 – Jan 2015]

Used machine learning for health care data analytics. Clustered co-morbidity for several sets of patients. Experience in data visualization. Worked with R, Python, and D3.js. Austin, Texas.
 

Internet Marketing Inc. — Web Developer Intern [Jun 2013 – Aug 2013]

Set up Unix servers and configured SQL databases. Developed over 20 websites in the summer. Managed and maintained cloud servers. Worked with HTML, CSS, PHP, JavaScript, and jQuery. Las Vegas, Nevada.
 

Research

Robotics Lab at UT Austin, Dr. Peter Stone/Dr. Justin Hart [Dec 2017 – Apr 2018]

Worked on semantic mapping and social navigation for non-anthropomorphic robots with Building-wide Intelligence (BWI) project. Austin, Texas.
 

Robotics Lab at UT Austin, Dr. Andrea Thomaz/Dr. Scott Niekum [Jan 2016 – May 2017]

Research in human robot interaction in the Personal Autonomous Robotics Lab (PeARL) and Socially Intelligent Machines (SiM) Lab. Experience in behavior architectures, perception, manipulation, and machine learning. Austin, Texas.
 

Wireless Networking & Communication Group, Dr. Joydeep Ghosh [Aug 2014 – Jan 2016]

Selected by Professor Joydeep Ghosh in the University of Texas Electrical and Computer Engineering department in the Intelligent Data Exploration and Analysis Laboratory (IDEAL). Lab focuses on machine learning and data mining. Research on making self-driving cars a safe reality using distributed machine learning through wireless mmWave communication in collaboration with Dr. Robert Heath. [In the news] Austin, Texas.
 

Publications

PRISM: Pose Registration for Integrated Semantic Mapping [pdf]

Justin Hart, Rishi Shah, Sean Kirmani, Nick Walker, Kathryn Baldauf, Nathan John, Peter Stone
Under review at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018.
 

Passive Demonstrations of Light-Based Robot Signals for Improved Human Interpretability

Rolando Fernandez, Nathan John, Sean Kirmani, Justin Hart, Jivko Sinapov, Peter Stone
Under review at the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2018.
 

Projects

Deep Reinforcement Learning for Aerial Obstacle Avoidance using Monocular RGB Image [2017-2018] [report] [video]

Used a variant of A3C to train a drone to avoid obstalces in a goal-centric setting in simulation with the hope to eventually transfer onto a real drone. Final project for CS 395T Robot Learning and senior capstone project.
 

Robot Grasping Simulator [2018] [video 1] [video 2] [video 3]

A robot arm simulator with 3D rigid body collisions, simple frictional contacts, and inverse kinematics to simulate the arm joints. We also got it working on a real robot arm! Final project for CS 395T Physical Simulation.
 

FaceTracker: Embedded Face Tracking Camera [2017] [demo]

Designed a PCB and wrote a server to track faces on an embedded system. Final project for EE 445L Embedded Systems.
 

Playing Supertuxkart with (Deep) Imitation Learning [2017] [video]

Use DAgger to train supertuxkart to play itself. Final project for CS 342 Neural Networks.
 

Interruptable Human-Robot Floor Regulation [2016] [code] [demo]

Re-implemented a simple version of Crystal Chao‘s CADENCE to work with ROS. Final project for EE 382V Human-Robot Interaction.
 

Augmented Reality Brick Breaker [2016] [code] [demo] [other demo]

Augmented reality brick breaker game using Google’s Project Tango. Final project for CS 354 Computer Graphics.
 

AR Collision Experiment [2016] [code] [demo] [other demo]

An augmented reality sandbox built on top of Google’s Project Tango.
 

Social VR Experiment [2015] [code] [demo]

Social communication over the internet with virtual reality. Powered by Google Cardboard. The goal of this project is to create an immersive communication experience that anyone can use with their phone to communicate in the best way possible. Interact with each other like I’m there.
 

Kirmani.io [2010 – 2016] [code]

This is the one stop shop for all things Sean Kirmani. I keep a blog, manage my email, host my resume, and anything else you can imagine on this domain. I tend to test out and develop new projects on here, and sometimes I might put a completed project on another domain or subdomain. This website runs on a CentOS server.
 

Google Cardboard Base Template [2015] [code]

A simple modularized template to make Google Cardboard VR Projects easily! Based on the idea of modular CardboardObjects.
 

kirmani/code [2015] [code]

A source for all the code I’ve written and committed to Github! A good way to keep track of what I’m working on.
 

Go Slash [2015] [code]

A custom go/ redirect link system for short links.
 

Chrome Hue Ambient Color Picker [2015] [code]

A Chrome extension that makes Phillips Hue lightbulbs match the color of the dominant color of the active window in Google Chrome.
 

Classie [2015] [code]

A simple site that visualizes who has taught a class at UT Austin in previous semesters. Also attempts to predict if a class will be offered again in the future.
 

GradRanker [2015]

A website I made that you can submit your graduate admission statistics, and it uses some fancy machine learning (a deep neural network) to predict whether you would get into a certain graduate school for a certain graduate field. Make it even better by submitting your stats by clicking the plus button in the bottom right on the page!
 

Interactive Sorting Algorithm Visualizations [2015] [code]

An interactive visualization of popular sorting algorithms. Powered by AngularJS.
 

Google Notebook [2014] [code]

A simple notebook webapp built using AngularJS. It supports todos, weather, and universal search powered by Google’s Freebase API. Have any suggestions for cards? Let me know!
 

iOS Resume [2014]

This app is a mobile version of my resume. I made this app in about 2 days, and used it to practice my Objective-C. It dynamically updates based on my personal website, and does not need a software update to display new content.
 

UniXrim [2014] [code]

A jQuery based Unix terminal emulator. It can parse HTML to strictly grab only the text of a blog, and it can open and read text files. (Press the “~” key right now to try it out!)
 

News.ly [2013] [deprecated]

An iOS application that displays RSS feeds in a beautiful way to aggregate the news you want to see. Inspired by Bing News for Windows Phone.
 

FiftyFifty [2012] [site offline]

Test your luck! You are presented with two options in a headline, one good and one bad. There is a 50-50 chance that a good or bad option will appear. Based off of the popular subreddit /r/fiftyfifty and also pulls data from the most popular posts of all time from the subreddit.
 

Xbox Live Mobile [2012]

An iOS application that lets Xbox users see what their friends are up to. Features included the ability to send messages, check achievements, compare with friends, add/remove friends. Inspired by Xbox Games app for Windows Phone.
 

Sites I Built

I started designing websites at age 11, when I first learned HTML. Since then, I’ve built lots of sites, mostly for myself, but a few for organizations that I like:
 

Robspin [2015] [code]

Just Rob.
 

IEEE UT [2015] [code]

The University of Texas at Austin Chapter of IEEE.
 

ClockOrBomb.com [2015] [code]

A website to help people learn what a clock is, how it’s not a bomb, and in general let people know about the inclusivity problem in tech.
 

UT ECE Data Science Engineering [2015] [code]

The big data research page for University of Texas Electrical and Computer Engineering Department. A subset of the Wireless Networks and Communications Group.
 

Facebook Group Interaction Graph [2015] [code]

A visualization of interaction across UT Computer Science students on Facebook. Powered by D3JS, Angular, and the Facebook Graph API.
 

Pi to One Million Digits [2015] [code]

A website that outputs pi accurate to over one million (actually 1,262,625) digits.
 

Toaster [2015] [code]

A terminal toaster emulator.
 

Intelligent Data Exploration and Analysis Laboratory [2014]

The group web page for the Dr. Joydeep Ghosh lab.
 

Conner Spin [2014] [code]

LSD and Conner Lawrence.
 

Kinetic Typewriter [2014] [code]

An online tool that allows users to create typographical art that automatically adjusts text size of a line so that it justifies with the edge. Made out of frustration in an hour after being unable to easily do so in other software.
 

RoosterTweet [2013]

A simple website which aggregates tweets for employees of the company Rooster Teeth.
 

Organizations

Institute of Electrical and Electronics Engineers

Communications Director, May 2016 – May 2017

Assistant Officer in Communications, Sep 2015 – May 2016

 

Institute of Electrical and Electronics Engineers, Computer Society

Publicity Chair, Sep 2015 – May 2016

 

Tau Beta Pi (Engineering Honor Society)

Member by Invitation, Sep 2015 – Present

 

Eta Kappa Nu (Electrical Engineering Honor Society)

Member by Invitation, Sep 2016 – Present

Contact Info

 

Skills & Interests

Interests

  • Robot Learning
  • 3D Computer Vision
  • Reinforcement Learning
  • Neural Networks
  • Artificial Intelligence
  • Human–Robot Interaction

 

Familiar Technologies

  • ROS
  • Tensorflow
  • OpenGL (and libigl)
  • Vim
  • Git
  • UNIX
  • Android Development

 

Talks

Daydreaming in Class: Building Virtual Reality Apps on Android [Apr 2016] [slides]

Lead workshop on virtual reality app development with Google Cardboard for University of Texas IEEE CS.
 

Python Workshop [Nov 2015] [slides]

Talk at University of Texas IEEE CS.
 

Hackathons

TreeHacks [Feb 2016] [code]

Wrote a server and Google Project Tango Android application for multiple devices to share an aligned coordinate frame in augmented reality. Stanford University, Palo Alto, California.
 

CodeRED [Nov 2015] [code] [demo]

Won 2nd Place and Most Creative Project. Made a smart door lock that could be opened on iOS. Made the circuit, HTTP server API, and iOS app from scratch in 24 hours. Used Raspberry Pi, OpenCV, Flask, and iOS Swift SDK. Houston, TX.
 

HackTX [Sep 2015]

Made a hand pose recognizer using the Leap Motion and then helped mentor other teams. Austin, TX.
 

InternHacks [July 2015]

Helped friends make their personal websites. San Francisco, CA.
 

Volunteering

Hour of Code [Dec 2015 and Dec 2016]

An initiative of code.org, a nonprofit organization committed to pushing the growth and diversity of the computer science community by making the discipline more accessible through one-hour programming tutorials and activities. The Hour of Code program is timed to correspond with Computer Science Education week. The goal is to encourage as many people as possible spend an hour coding during that week.
 

I’m also a …

  • cinephile
  • hip-hop head
  • comedy nerd
  • frisbee enthusiast