Bachelor of Science, Computer Science ’18
Bachelor of Science, Electrical Engineering ’18
Honors Capstone Project: Deep Reinforcement Learning for Aerial Obstacle Avoidance using Monocular RGB Images
Selected Coursework: Show
- Robot Learning (CS 395T)
- Human Robot Interaction (EE 382V)
- Artificial Intelligence (CS 343)
- Neural Networks (CS 342)
- Computer Vision (CS 378H)
- Computer Graphics (CS 354)
- Physical Simulation (CS 395T)
- Operating Systems (CS 439)
- Signal Processing (EE 313)
- Computer Architecture (EE 460N)
- Embedded Systems (EE 445L)
X — Software Engineer, Robotics [July 2018 – Present]
Working on perception team. Mountain View, California.
X — Software Engineering Intern, Robotics [May 2017 – Aug 2017]
Worked on perception for human-robot interaction. Mountain View, California.
Google — Software Engineering Intern, Project Tango [May 2016 – Aug 2016]
Worked on experimental augmented reality. Created environmental lighting system allowing more photorealistic lighting and reflections in augmented reality for Tango SDK. Published Google Developer Blog post with tutorial for usage. Also experimented with video stabilization. Experience in computer vision, computer graphics, and computational photography. Worked with C++, Unity, and Java. Mountain View, California.
Google — Software Engineering Intern, Chrome for Android [May 2015 – Aug 2015]
Served as an intern on tools and infrastructure for Chrome for Android. All code is open source as part of Chromium. Wrote test infrastructure for sign-in authentication test. Also created parametrizable testing framework. All my code is open source as part of Chromium! Worked with Java, Python, and C++. Mountain View, California.
Accordion Health — Software Engineer [Aug 2014 – Jan 2015]
Used machine learning for health care data analytics. Clustered co-morbidity for several sets of patients. Experience in data visualization. Worked with R, Python, and D3.js. Austin, Texas.
Internet Marketing Inc. — Web Developer Intern [Jun 2013 – Aug 2013]
Robotics Lab at UT Austin, Dr. Peter Stone/Dr. Justin Hart [Dec 2017 – Apr 2018]
Worked on semantic mapping and social navigation for non-anthropomorphic robots with Building-wide Intelligence (BWI) project. Austin, Texas.
Robotics Lab at UT Austin, Dr. Andrea Thomaz/Dr. Scott Niekum [Jan 2016 – May 2017]
Research in human robot interaction in the Personal Autonomous Robotics Lab (PeARL) and Socially Intelligent Machines (SiM) Lab. Experience in behavior architectures, perception, manipulation, and machine learning. Austin, Texas.
Wireless Networking & Communication Group, Dr. Joydeep Ghosh [Aug 2014 – Jan 2016]
Selected by Professor Joydeep Ghosh in the University of Texas Electrical and Computer Engineering department in the Intelligent Data Exploration and Analysis Laboratory (IDEAL). Lab focuses on machine learning and data mining. Research on making self-driving cars a safe reality using distributed machine learning through wireless mmWave communication in collaboration with Dr. Robert Heath. [In the news] Austin, Texas.
PRISM: Pose Registration for Integrated Semantic Mapping [pdf]
Justin Hart, Rishi Shah, Sean Kirmani, Nick Walker, Kathryn Baldauf, Nathan John, Peter Stone
Under review at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018.
Passive Demonstrations of Light-Based Robot Signals for Improved Human Interpretability
Rolando Fernandez, Nathan John, Sean Kirmani, Justin Hart, Jivko Sinapov, Peter Stone
Under review at the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2018.
Deep Reinforcement Learning for Aerial Obstacle Avoidance using Monocular RGB Image [2017-2018] [report] [video]
Used a variant of A3C to train a drone to avoid obstalces in a goal-centric setting in simulation with the hope to eventually transfer onto a real drone. Final project for CS 395T Robot Learning and senior capstone project.
A robot arm simulator with 3D rigid body collisions, simple frictional contacts, and inverse kinematics to simulate the arm joints. We also got it working on a real robot arm! Final project for CS 395T Physical Simulation.
FaceTracker: Embedded Face Tracking Camera  [demo]
Designed a PCB and wrote a server to track faces on an embedded system. Final project for EE 445L Embedded Systems.
Playing Supertuxkart with (Deep) Imitation Learning  [video]
Use DAgger to train supertuxkart to play itself. Final project for CS 342 Neural Networks.
Augmented Reality Brick Breaker  [code] [demo] [other demo]
Augmented reality brick breaker game using Google’s Project Tango. Final project for CS 354 Computer Graphics.
AR Collision Experiment  [code] [demo] [other demo]
An augmented reality sandbox built on top of Google’s Project Tango.
Social communication over the internet with virtual reality. Powered by Google Cardboard. The goal of this project is to create an immersive communication experience that anyone can use with their phone to communicate in the best way possible. Interact with each other like I’m there.
Kirmani.io [2010 – 2016] [code]
This is the one stop shop for all things Sean Kirmani. I keep a blog, manage my email, host my resume, and anything else you can imagine on this domain. I tend to test out and develop new projects on here, and sometimes I might put a completed project on another domain or subdomain. This website runs on a CentOS server.
Google Cardboard Base Template  [code]
A simple modularized template to make Google Cardboard VR Projects easily! Based on the idea of modular CardboardObjects.
kirmani/code  [code]
A source for all the code I’ve written and committed to Github! A good way to keep track of what I’m working on.
A custom go/ redirect link system for short links.
Chrome Hue Ambient Color Picker  [code]
A Chrome extension that makes Phillips Hue lightbulbs match the color of the dominant color of the active window in Google Chrome.
A simple site that visualizes who has taught a class at UT Austin in previous semesters. Also attempts to predict if a class will be offered again in the future.
A website I made that you can submit your graduate admission statistics, and it uses some fancy machine learning (a deep neural network) to predict whether you would get into a certain graduate school for a certain graduate field. Make it even better by submitting your stats by clicking the plus button in the bottom right on the page!
An interactive visualization of popular sorting algorithms. Powered by AngularJS.
Google Notebook  [code]
A simple notebook webapp built using AngularJS. It supports todos, weather, and universal search powered by Google’s Freebase API. Have any suggestions for cards? Let me know!
iOS Resume 
This app is a mobile version of my resume. I made this app in about 2 days, and used it to practice my Objective-C. It dynamically updates based on my personal website, and does not need a software update to display new content.
A jQuery based Unix terminal emulator. It can parse HTML to strictly grab only the text of a blog, and it can open and read text files. (Press the “~” key right now to try it out!)
News.ly  [deprecated]
An iOS application that displays RSS feeds in a beautiful way to aggregate the news you want to see. Inspired by Bing News for Windows Phone.
FiftyFifty  [site offline]
Test your luck! You are presented with two options in a headline, one good and one bad. There is a 50-50 chance that a good or bad option will appear. Based off of the popular subreddit /r/fiftyfifty and also pulls data from the most popular posts of all time from the subreddit.
Xbox Live Mobile 
An iOS application that lets Xbox users see what their friends are up to. Features included the ability to send messages, check achievements, compare with friends, add/remove friends. Inspired by Xbox Games app for Windows Phone.
Sites I Built
I started designing websites at age 11, when I first learned HTML. Since then, I’ve built lots of sites, mostly for myself, but a few for organizations that I like:
The University of Texas at Austin Chapter of IEEE.
ClockOrBomb.com  [code]
A website to help people learn what a clock is, how it’s not a bomb, and in general let people know about the inclusivity problem in tech.
UT ECE Data Science Engineering  [code]
The big data research page for University of Texas Electrical and Computer Engineering Department. A subset of the Wireless Networks and Communications Group.
Facebook Group Interaction Graph  [code]
A visualization of interaction across UT Computer Science students on Facebook. Powered by D3JS, Angular, and the Facebook Graph API.
Pi to One Million Digits  [code]
A website that outputs pi accurate to over one million (actually 1,262,625) digits.
A terminal toaster emulator.
The group web page for the Dr. Joydeep Ghosh lab.
Conner Spin  [code]
LSD and Conner Lawrence.
Kinetic Typewriter  [code]
An online tool that allows users to create typographical art that automatically adjusts text size of a line so that it justifies with the edge. Made out of frustration in an hour after being unable to easily do so in other software.
A simple website which aggregates tweets for employees of the company Rooster Teeth.
Communications Director, May 2016 – May 2017
Assistant Officer in Communications, Sep 2015 – May 2016
Publicity Chair, Sep 2015 – May 2016
Member by Invitation, Sep 2015 – Present
Member by Invitation, Sep 2016 – Present
Skills & Interests
- Robot Learning
- 3D Computer Vision
- Reinforcement Learning
- Neural Networks
- Artificial Intelligence
- Human–Robot Interaction
- OpenGL (and libigl)
- Android Development
Daydreaming in Class: Building Virtual Reality Apps on Android [Apr 2016] [slides]
Lead workshop on virtual reality app development with Google Cardboard for University of Texas IEEE CS.
Python Workshop [Nov 2015] [slides]
Talk at University of Texas IEEE CS.
TreeHacks [Feb 2016] [code]
Wrote a server and Google Project Tango Android application for multiple devices to share an aligned coordinate frame in augmented reality. Stanford University, Palo Alto, California.
Won 2nd Place and Most Creative Project. Made a smart door lock that could be opened on iOS. Made the circuit, HTTP server API, and iOS app from scratch in 24 hours. Used Raspberry Pi, OpenCV, Flask, and iOS Swift SDK. Houston, TX.
HackTX [Sep 2015]
Made a hand pose recognizer using the Leap Motion and then helped mentor other teams. Austin, TX.
InternHacks [July 2015]
Helped friends make their personal websites. San Francisco, CA.
Hour of Code [Dec 2015 and Dec 2016]
An initiative of code.org, a nonprofit organization committed to pushing the growth and diversity of the computer science community by making the discipline more accessible through one-hour programming tutorials and activities. The Hour of Code program is timed to correspond with Computer Science Education week. The goal is to encourage as many people as possible spend an hour coding during that week.
I’m also a …
- hip-hop head
- comedy nerd
- frisbee enthusiast