Tag Archive for: robot

surgeon doing laparoscopic surgery

Autonomous robotic laparoscopic surgery for intestinal anastomosis

surgeon doing laparoscopic surgery

Children’s National Hospital in collaboration with the University of North Carolina Wilmington and Johns Hopkins University developed an enhanced autonomous strategy for laparoscopic soft tissue surgery.

A new approach to soft tissue surgery could simplify autonomous surgical planning and enable collaborative surgery between an autonomous robot and human, a new study published in Science Robotics finds. This is the first time a robot can complete an autonomous soft tissue surgical task under laparoscopic conditions, forming the foundation for future soft tissue surgeries.

Children’s National Hospital in collaboration with the University of North Carolina Wilmington and Johns Hopkins University developed an enhanced autonomous strategy for laparoscopic soft tissue surgery. The multi-institutional effort made it possible to perform a robotic laparoscopic small bowel anastomosis in phantom and in vivo intestinal tissues. The findings further suggest that autonomous robot-assisted surgery has the potential to provide more efficacy, safety and consistency independent of an individual surgeon’s skill and experience.

The hold-up in the field

Autonomous anastomosis is known to be a challenging soft tissue surgery task. And in the laparoscopic setting, surgeries like these prove to be more challenging because of the need for high maneuverability and repeatability under motion and vision constraints – especially in pediatric patients.

“This work represents the first time autonomous soft tissue surgery has been performed using a laparoscopic technique and is the first step in bridging the gap between human and machine towards completing autonomous surgical tasks in soft tissue surgeries,” says Hamed Saeidi, Ph.D., assistant professor at University of North Carolina Wilmington and lead author of the study.

To overcome the unpredictable motions of the tissue, the experts used machine learning based techniques to track the dynamic motions of the soft tissue during the surgery. These methods also pave the way for markerless methods for tracking the tissue motion in future surgeries.

“Until now, laparoscopic autonomous surgeries were not possible in soft tissue due to the unpredictable motions of the tissue and limitations on the size and capabilities of surgical tools,” says Justin Opfermann, M.S., Ph.D., student and Johns Hopkins University and co-author.

What’s unique

Performing autonomous surgery would require the development of novel suturing tools, imaging systems and robotic controls to visualize a surgical scene, generate an optimized surgical plan and then execute that surgical plan with the highest precision.

The autonomous robot takes its skill one step further when performing surgical tasks on soft tissues by enabling a robot-human collaboration to complete more complicated surgical tasks where preoperative planning is not possible.

Additionally, the robot used in this work uses a novel shared control scheme called “conditional autonomy,” whereby the robot performs the majority of the surgical task, which the surgeon oversees.

Bottom line

“Combining all of these features into a single system is non-trivial,” Opfermann adds. “In 2016, we were the first group to demonstrate feasibility of semi-autonomous small bowel anastomosis with a robot in soft tissue, and now we can perform autonomous laparoscopic anastomosis.”

The resulting anastomosis had more consistency and achieved higher burst strength than surgeons suturing with manual technique, resulting in less anastomotic leak.

In laparoscopic surgeries – and pediatric patients especially – these challenges are even more difficult due to the small size of the patient. Robotic anastomosis is one way to ensure that surgical tasks that require high precision and repeatability can be performed with more accuracy and precision in every patient independent of surgeon skill.

“As a surgeon, I can attest to the potential benefits of improving how we perform surgery on our patients,” says Michael Hsieh, M.D., Ph.D., director of Transitional Urology at Children’s National Hospital. “Working with my engineering colleagues at Johns Hopkins, we’ve been able to develop prototypes of supervised, autonomous suturing robots that may be a step towards such improvements.”

patient meets with ED robot

New robot helps care for kids in the emergency room at Children’s National Hospital

patient meets with ED robot

The robot, which is part of the FCC-funded COVID-19 Telehealth Program at Children’s National, is the latest innovation of the program that has rapidly evolved due to the ongoing pandemic.

Children and families who come into the emergency room at Children’s National Hospital may be surprised when their doctor comes in – in the form of a robot. Children’s National introduced a new robot to its Emergency Department (ED) for patients under evaluation for a COVID infection or being treated for other conditions. The robot, which is part of the FCC-funded COVID-19 Telehealth Program at Children’s National, is the latest innovation of the program that has rapidly evolved due to the ongoing pandemic.

“The robot can move in and out of spaces that otherwise we couldn’t get a significant number of providers in, especially with COVID-19 restrictions in place,” said  Shireen Atabaki, M.D., M.P.H., associate medical director of Telemedicine, emergency medicine physician and program director for the COVID-19 Telehealth Program at Children’s National. “This is a really exciting program and it implements innovation that we might not have been able to do without the insights we’ve gained from the pandemic.”

The robot is Wi-Fi-enabled and can be remotely controlled by the physician providing the teleconsultation to monitor patient vitals — such as heart rate, body temperature or respiration rate. This allows doctors to work virtually with their team while also having the flexibility to attend to patients faster.

“The pandemic has made us aware of the need to protect patients, families and staff from infectious diseases,” said  Alejandro Jose Lopez-Magallon, M.D., medical director of Telemedicine at Children’s National. The robot, he noted, spares clinicians from having to change their PPE, which saves time and gives them the ability to move on to the next patient while nurses and staff continue to provide bedside care.

“We have also seen that whenever a remote clinician is completely alone in the command center and can get on-screen without a mask, in a paradoxical way our patients may be more accepting of seeing a face on a screen that’s not covered with a mask and shield than a stranger using a mask in the same room,” Dr. Lopez-Magallon added.

Soon, the robot will also be used to coordinate subspecialty care — such as cardiac care — in the ED. This will provide more streamlined and expedited care for patients. Instead of leaving with a referral to set up a follow-up appointment with a specialist, patients would be able to receive the consult they need during the same appointment.

The robot is also presenting promising solutions for concerns around the number of restricted visitors. The team at Children’s National recently piloted using an iPad and other technology purchased with the FCC funds to remotely connect family members with patients.

“We downloaded the Zoom app to iPads in our ED to be able to coordinate calls between family members who can’t come in and see patients,” said Dr. Atabaki. “We are looking to implement this as a permanent solution keeping in mind how burdensome and emotionally stressful it has been for many not having the ability to be by the loved one’s side during such a challenging time.”

The FCC funds also covered the telehealth carts, tablets and other connected devices, the telehealth platform, telehealth equipment and innovative AI (augmented intelligence) to treat seriously ill COVID-19 pediatric patients.

The emergency department robot brings the robot-fleet at Children’s National up to three. The first robot was debuted in 2019 to serve children and families in the Cardiac Intensive Care Unit.

Dr. Bear Bot

Advances in telemedicine start with new cardiac critical care robot

Dr. Bear Bot

Dr. Bear Bot’s “robot-only” parking space in the Cardiac ICU. Alejandro Lopez-Magallon, M.D., is featured on the robot display screen, where he drives the robot from his location in the command center, in order to visit patient rooms and capture additional medical information and connect with patients, parents, and attending nurses and physicians.

The telemedicine robot at Children’s National arrived in late August 2018 and recently completed a 90-day test period in the tele-cardiac intensive care unit (cardiac ICU) at Children’s National. The bot travels between rooms as a virtual liaison connecting patients and attending nurses and physicians with Ricardo Munoz, M.D., executive director of the telemedicine program and the division chief of critical cardiac care, and Alejandro Lopez-Magallon, M.D., a cardiologist and medical director of the telemedicine program.

Drs. Munoz and Lopez-Magallon use a nine-screen virtual command center to remotely monitor patient vitals, especially for infants and children who are recovering from congenital heart surgery, flown in for an emergency diagnostic procedure, such as a catheterization, or who are in the process of receiving a heart or kidney transplant. Instead of traveling to individual rooms to check in on the status of one patient, the doctors can now monitor multiple patients simultaneously, enhancing their ability to diagnose, care for and intervene during critical events.

If Drs. Munoz or Lopez-Magallon need to take an X-ray or further examine a patient, they drive the robot from its ‘robot-only’ parking space adjacent to the nurse’s station, and connect with attending doctors and nurses in the teaming area. The onsite clinicians accompany one of the telemedicine doctors, both of whom remain in the command center but appear virtually on the robot’s display screen, to the patient’s room to capture additional medical information and to connect with patients and families.

Over time, the telemedicine team will measure models of efficiency in the tele-cardiac ICU, such as through-put, care coordination, and standards of safety, quality and care, measured by quality of life and short- and long-term patient health outcomes. This test run will serve as a model for future command centers offering remote critical care.

Ricardo Munoz and Alejandro Lopez-Magallon

(R) Ricardo Munoz, M.D., executive director of the telemedicine program and the division chief of critical cardiac care, and Alejandro Lopez-Magallon, M.D., a cardiologist and the associate medical director of the telemedicine program in the tele-cardiac ICU command center.

“As technology and medicine advance, so do our models of telemedicine, which we call virtual care,” says Shireen Atabaki, M.D., M.P.H., an emergency medicine physician at Children’s National, who manages an ambulatory virtual health program, which enables patients to use virtual health platforms to connect with doctors, but from the comfort of their home. “We find the patient-centered platforms and this new technology saves families’ time and we’re looking forward to studying internal models to see how this can help our doctors, enabling us to do even more.”

The ongoing virtual connection program that Dr. Atabaki references launched in spring 2016 and has enabled 900 children to connect to a doctor from a computer, tablet or smart phone, which has saved families 1,600 driving hours and more than 41,000 miles over a two-year period. Through this program, virtual care is provided to children in our region by 20 subspecialists, including cardiologists, dermatologists, neurologists, urgent care doctors, geneticists, gastroenterologists and endocrinologists.

To extend the benefits of virtual communication, while saving mileage and time, Dr. Atabaki and the telemedicine team at Children’s National will partner with K-12 school systems, local hospitals and health centers and global health systems.

The Children’s National robot was named Dr. Bear Bot after a 21-day voting period with patients and staff, beating 14 other child-selected names, including SMARTy (Special Medical Access to Remote Technology), Dr. Bot and Rosie. Dr. Bear Bot celebrated with an official reveal party on Valentine’s Day, which was streamed to over 220 patients through the hospital’s closed-circuit television and radio station.

Dr. Michael Hsieh's clay shield

Innovative urologist Michael Hsieh takes unbeaten path

Dr. Michael Hsieh's clay shield

For an elementary school art project, Michael H. Hsieh, M.D., Ph.D., was instructed to fashion a coat of arms out of clay. In addition to panels for truth, justice and Taiwan, in the shield’s M.D. panel, a snake twists around a rod, like the staff for Asclepius, a Greek god associated with healing.

Children’s urologist Michael H. Hsieh, M.D., Ph.D., knew from age 10 that he would become a doctor. Proof is at his parents’ home. For an elementary school art project, students were instructed to fashion a coat of arms out of clay. In addition to panels for truth, justice and Taiwan, in the shield’s M.D. panel, a snake twists around a rod, like the staff for Asclepius, a Greek god associated with healing.

“I liked science. When I can use it to help patients, that is very rewarding,” says Dr. Hsieh, the first doctor in his family.

These days, Dr. Hsieh’s Twitter profile serves as a digital coat of arms, describing him as “tinker, tailor,” #UTI #biologist, epithelial #immunologist, helminthologist and #urologist.

Tinker/tailor is shorthand for the mystery drama, “Tinker Tailor Solider Spy,” he explains, adding that the “tinker” part also refers “to the fact that I am always questioning things, and science is about experimentation, trying to seek answers to questions.”

While still in medical school during a rotation Dr. Hsieh saw a bladder operation on a young child and thought it was “amazing.” That experience in part inspired Dr. Hsieh to become a urologist and bladder scientist. His training in immunology and study of the bladder naturally led him to study urinary tract infections and parasitic worms that affect the urinary tract. In addition, thanks to R01 funding from the National Institutes of Health (NIH), Dr. Hsieh is co-principal investigator with Axel Krieger, University of Maryland, and Jin U. Kang, Johns Hopkins, on a project to develop imaging robots for supervised autonomous surgery on soft tissue.

The $1 million in NIH funding pushes the boundaries on amazing by using multi-spectral imaging technology and improved techniques to reduce surgical complications.

Anastomosis is a technique used by surgeons to join one thing to another, whether it’s a vascular surgeon suturing blood vessels, an orthopedic surgeon joining muscles or a urologist stitching healthy parts of the urinary tract back together. Complications can set in if their stitching is too tight, prompting scar tissue to form, or too loose, letting fluid seep out.

“The human eye can see a narrow spectrum of electromagnetic radiation. These multi-spectral imaging cameras would see across greater set of wavelengths,” he says.

The project has three aims: figuring out the best way to place sutures using multi-spectral imaging, accurately tracking soft tissue as they model suturing and comparing the handicraft of a robot against anastomosis hand-sewn by surgeons.

“I like challenges, and I like new things. I am definitely not interested in doing permutations of other people’s work,” Dr. Hsieh explains. “I would much rather go on a path that hasn’t been tread. It is more difficult in some ways, but on a day-to-day basis, I know I am making a contribution.”

In another innovative research project, Dr. Hsieh leveraged a protein secreted by a parasitic worm, Schistosoma haematobium, that suppresses inflammation in hosts as a new therapeutic approach for chemotherapy-induced hemorrhagic cystitis, a form of inflammation of the bladder.

Watching his first surgery nearly 30 years ago, he had no idea robots might one day vie to take over some part of that complicated procedure, or that parasite proteins could be harnessed as drugs. However, he has a clear idea which innovations could be on the horizon for urology in the next three decades.

“My hope is 30 years from now, we will have a solid UTI vaccine and more non-antibiotic therapies. UTIs are the second-most common bacterial infection in childhood and, in severe cases, can contribute to kidney failure,” he says.

Globally, parasitic worms pose an ongoing challenge, affecting more than 1 billion worldwide – second only to malaria. People persistently infected by schistosome worms fail to reach their growth potential, struggle academically and lack sufficient energy for exercise or work.


“There is a feeling that the infection prevalence might be decreasing globally, but not as quickly as everyone hopes. In 30 years perhaps with more mass drug administration and additional drugs – including a vaccine – we’ll have it close to eliminated globally. It would become more like polio, casting a slim shadow with small pockets of infection here or there, rather than consigning millions to perpetual poverty.”

Smart Tissue Autonomous Robot (STAR)

Popular Science awards smart tissue autonomous robot

stm-star01rescaled

Technology developed in the Sheikh Zayed Institute for Pediatric Surgical Innovation at Children’s National has been named one of the 12 Most Important Health Innovations of the Year in the November/December 2016 issue of Popular Science. Smart Tissue Autonomous Robot (STAR), a technology that performed the first supervised, autonomous robotic soft tissue surgery on a live subject (in vivo) this year, has been awarded a 2016 Popular Science Best of What’s New Award in the Health category.

How the smart tissue autonomous robot works

STAR removes the surgeon’s hands from the procedure, instead utilizing the surgeon as supervisor, with soft tissue suturing autonomously planned and performed by the STAR robotic system.  The system integrates near infrared florescent (NIRF) markers and 3-D plenoptic vision to provide uninhibited tracking of tissue motion. This tracking is combined with an intelligent algorithm that autonomously adjusts the surgical plan in real time as tissue movements occur.

About Popular Science health innovations of the year

Each year, the editors of Popular Science review thousands of products in search of the top 100 tech innovations of the year—breakthrough products and technologies that represent a significant leap in their categories.

The Best of What’s New awards honor the innovations that shape the future,” says Kevin Gray, Executive Editor, Popular Science. “From lifesaving technology to incredible space engineering to gadgets that are just breathtakingly cool, this is the best of what’s new.”