Machine Design
  • Resources
  • Members
  • Directory
  • Webinars
  • WISE
  • CAD Models
  • Advertise
    • Search
  • 3D Printing & CAD
  • AUTOMATION & IIOT
  • Robotics
  • Motion Systems
  • Materials
  • Video
  • Data Sheets
  • Topics
    Industry Markets3D Printing & CADAutomation & IIoTFastening & JoiningMaterialsMechanical & Motion Systems Medical DesignRobotics
    Resources
    Machine Design ResourcesWISE (Workers in Science & Engineering)Company DirectorySearch Data SheetsContributeDigital Edition ArchivesCSIA Exchange
    Members
    ContentBenefitsSubscribe
    Advertise
    https://www.facebook.com/MachineDesignMagazine/
    https://www.linkedin.com/company/10998894
    https://twitter.com/MachineDesign
    https://www.youtube.com/channel/UCXKEiQ9dob20rIqTA7ONfJg
    1. News

    Vision Sensor Helps Make Robot a Guitar Hero

    Oct. 5, 2009
    Banner Engineering vision sensor helps make robot a guitar hero.

    Banner Engineering Corp., www.bannerengineering.com

    Minnesota West Community and Technical College, www.mnwest.edu

    Watch a video of this robotic guitar hero, tiny.cc/mocHR

    Video of another Guitar-Hero-playing system from Cyth Systems, tiny.cc/frwUC

    Engineering student Peter Nikrin got a bit upset when his friend bested him at Guitar Hero, a video game where players score points by correctly hitting keys on a plastic guitar as “notes” to popular rock tunes scroll by on a TV. Rather than buckle down and practice so he could beat his friend’s score, Nikrin decided to build a robot that could.

    The robot depends to a large degree on a vision sensor able to quickly detect the notes as they scroll by. Nikrin’s first attempt used five fiber-optic photoelectric sensors, one for each key/note color. But the sensors could not detect the notes, which were just moving spots of color on a video screen. It turned out the fiber-optic sensors didn’t match up well with video; they worked best at detecting light reflecting from a solid object.

    A PresencePlus P4 Omni sensor from Banner Engineering, Minneapolis, worked better. His school had purchased one as a start-up educational kit. Nikrin also used a right-angle lens from Banner so that the sensor would fit inside the robot’s head. It took some programming effort before the robot could read signals from the monochromatic sensor to detect and identify notes by position rather than color. A bit more programming went into recognizing the white circle surrounding a note that indicates the right instant to play that note.

    It takes the robot about 9 msec to recognize that it’s time to play a note. That’s when it sends a signal to one of five solenoids that activate the robot’s five fingers.

    The robot, named Roxanne, averages 98% accuracy on the game’s medium setting. “The higher the difficulty level, the less accurate the robot is, but this is mostly a mechanical issue,” says Nikrin. “I spent so much time on programming that I didn’t have time to focus on the solenoids, so the robot can’t press buttons fast enough to beat the most difficult levels. But the vision system itself hits the notes correctly 100% of the time at all difficulty levels.”

    Sponsored Recommendations

    Smart Factory Solutions that Connect and Protect from Amphenol RF

    Nov. 28, 2023

    Stay Connected and In Control of Your Future Factories with Littelfuse

    Nov. 28, 2023

    Turn to NKK Switches for the Widest Range of Industrial-Savvy Electromechanical Switches

    Nov. 28, 2023

    Unlocking Operational Flexibility in Manufacturing with Industria IoT

    Nov. 28, 2023

    Voice your opinion!

    To join the conversation, and become an exclusive member of Machine Design, create an account today!

    I already have an account

    New

    Technology For Optimizing Sliding Door Mechanics: Precision-Machined Hybrid Polymer Roller

    Track Rollers Reimagined: Durability Meets Innovation

    Engineer’s Guide: Unforeseen Benefits of Polymer-Hybrid Cam Followers

    Most Read

    A Beginner’s Guide to Design Failure Mode and Effects Analysis (DFMEA)

    Using Natural Language Understanding to Power Productivity

    Brushed vs Brushless Motors: Which is Best for your Application?

    Machine Design
    https://www.facebook.com/MachineDesignMagazine/
    https://www.linkedin.com/company/10998894
    https://twitter.com/MachineDesign
    https://www.youtube.com/channel/UCXKEiQ9dob20rIqTA7ONfJg
    • About Us
    • Contact Us
    • Advertise
    • Do Not Sell or Share
    • Privacy & Cookie Policy
    • Terms of Service
    © 2023 Endeavor Business Media, LLC. All rights reserved.
    Endeavor Business Media Logo