Skip to main content

CU COVID ALERT: Red, High-Risk - Rebuilding the Bubble – Spring 2021 Info

Primary Navigation

  • About
    • Maps & Directions
    • President's Page
    • The Clarkson Brand
    • Strategic Plans
    • History & Facts
    • Accreditation
    • Accolades
    • Board of Trustees
  • Academics
    • Undergraduate
    • Graduate
    • School of Arts & Sciences
    • Lewis School of Health Sciences
    • Reh School of Business
    • Coulter School of Engineering
    • Beacon Institute for Rivers and Estuaries
    • Institute for a Sustainable Environment
    • Institute for STEM Education
    • Academic Affairs
    • Academic Calendar
  • Admissions
    • First-Year Admissions, Undergraduate
    • Transfer Admissions, Undergraduate
    • International Admissions, Undergraduate
    • Early College Program: The Clarkson School
    • Graduate School Admissions
    • Financial Aid
    • Apply Now
  • Life
    • Office of Student Life
    • Student Clubs & Activities
    • Living on Campus
    • Campus Dining
    • Clarkson Ignite
    • Career & International Experiences
    • Explore the Region
    • Diversity & Inclusion
    • Student Health & Counseling
    • ROTC
  • Research
  • Athletics
  • News

Information for

  • Visit
  • Apply
  • Request Info
  • Give
  • Alumni
  • Parents
  • Intranet

CU • News & Events

Clarkson Professors Receive Robot to Continue Human-Robot Handover Interaction Research

Release Date
Wednesday December 18, 2019
Robot Grant
Left to right: Yijun Jiang, Graduate Student, Computer Science, Elim Schenck ‘21 Computer Science & Computer Engineering, Assistant Professors of Computer Science Natasha and Sean Banerjee

Clarkson University Computer Science Assistant Professors Natasha and Sean Banerjee recently received a new mobile grasp robot through a joint Facebook and Carnegie Mellon grant that will be used to further their research related to intuitive human-robot handover interactions.

The Banerjees are one of just 30 grant proposals to be awarded one of the robots, known as a LoCoBot. The robot will help the professors continue with their research on augmenting robots to be human-aware by using deep learning to automatically detect where humans prefer to hold objects and provide assistance with human awareness built-in.

“The driving force behind this research was that we are very rapidly moving toward a world where robots are going to be a part of our daily interactions, so it is really important for those robots to collaborate and cooperate with humans because it does not make sense for them to just be independent,” said Natasha Banerjee. "We are spurring a new area of research on creating artificial intelligence (AI) algorithms for robots that are human-aware. There is a pretty broad research area on human-robot interaction or HRI, but a lot of this research has focused on experimental or toy problems. My research makes novel contributions to HRI by assessing how to ensure a robot hands over an object to a human such that a human is comfortable holding it."

Banerjee said she has recently presented work that focuses on detecting where humans prefer to hold cups, and that research can help determine where robots should be gripping objects to best interact with humans.

“Let’s say you have an elderly individual and they want assistance. A cup is at a height where they are not able to get it. If you had an assistive robot that had a gripper arm, then the robot should hold the cup around the body so the person can hold it around the handle, especially if there are hot contents. A robot’s gripper is able to handle that heat better than a human hand,” Banerjee said.

Banerjee said where her research is beginning to differ is that no one else is using a data-driven perspective, and most other researchers have only been looking at one object at a time, such as a bottle or a screwdriver.

“If you want these robots to be universally acceptable they have to be able to understand any object in your environment and predict where a human is likely to hold an object,” she said.

Being able to predict this requires machine learning. Banerjee said she and her team are using a special brand of computational neural networks that help predict a distribution map that can indicate where humans are more likely to hold an object.

The robot is equipped with a camera that can be used to create an image that combines color and depth to tell the robot where it should prefer to hold an object based on where a human would hold it. The robot will analyze how to hold the object in places where a human would tend not to. This method can be used to create predictions for any average object.

The Banerjees work with three students on the project. Yijun Jiang is a computer science graduate student, who works on research for the project and comes up with algorithms to support the work. Elim Schenck is a double major in computer science and computer engineering, who supports the work of Jiang by helping develop algorithms and has been in charge of learning the controls for the robot. Electrical engineering student Jack Lamuraglia has been in charge of assembling the robotic platform and getting it running.

As a private, national research university, Clarkson is a leader in technological education and sustainable economic development through teaching, scholarship, research and innovation. We ignite personal connections across academic fields and industries to create the entrepreneurial mindset, knowledge and intellectual curiosity needed to innovate world-relevant solutions and cultivate the leaders of tomorrow. With its main campus located in Potsdam, N.Y., and additional graduate program and research facilities in the New York Capital Region, Beacon, N.Y., and New York City, Clarkson educates 4,300 students across 95 rigorous programs of study in engineering, business, the arts, education, sciences and health professions. Our alumni earn salaries that are among the top 2% in the nation and realize accelerated career growth. One in five already leads as a CEO, senior executive or owner of a company. To learn more about Clarkson University, go to www.clarkson.edu.


Photograph for media use is available at:
/sites/default/files/media/image/2019-12/robot-grant.jpg

Photograph Size:
Width: 4500px
Height: 3000px

News directors and editors: For more information, contact Melissa Lindell, Director of Media Relations, at 315-268-6716 or mlindell@clarkson.edu.

Schools at Clarkson

  • Graduate School
  • School of Arts & Sciences
  • David D. Reh School of Business
  • Wallace H. Coulter School of Engineering
  • Earl R. and Barbara D. Lewis School of Health Sciences
  • Institute for a Sustainable Environment
  • Early College Program: The Clarkson School
  • Institute for STEM Education
  • Beacon Institute for Rivers and Estuaries

Highlights of Excellence

  • Career Center
  • Honors Program
  • ROTC
  • SPEED
  • Student Success Center
  • Writing Center

Research & Innovation

  • Clarkson Center for Complex Systems Science (C3S2)
  • The Center for Advanced Materials Processing (CAMP)
  • Center for Air Resources Engineering & Science (CARES)
  • Center for Identification Technology Research (CITeR)
  • The Center for Rehabilitation Engineering, Science & Technology (CREST)
  • The Center for Sustainable Energy Systems (CSES)
  • NYS Center of Excellence in Healthy Water Solutions
  • The Shipley Center for Innovation
  • Clarkson Ignite
  • University Libraries

Clarkson University

8 Clarkson Ave., Potsdam, New York 13699 315-268-6400
80 Nott Terrace, Schenectady, NY 12308 518-631-9831
199 Main St., Beacon, New York 12508 845-838-1600
Take a Virtual Tour

Organizational Chart
© 2021 by Clarkson University | Contact the Webmaster

  • Human Resources • Giving
  • CARES Act Reports & Consumer Information Disclosures (HEOA)
  • Act on Legal & Moral Concerns
  • Daily Screening - Employees & Students