New technology makes internet memes accessible for people with visual impairments

To counter this, researchers at Carnegie Mellon University have developed a method to automatically identify memes and apply prewritten templates to add descriptive alt text, making them intelligible via existing assistive technologies.

Memes are images that are copied and then overlaid with slight variations of text. They are often humorous and convey a shared experience, but "if you're blind, you miss that part of the conversation," said Cole Gleason, a Ph.D. student in CMU's Human-Computer Interaction Institute (HCII.)

"Memes may not seem like the most important problem, but a vital part of accessibility is not choosing for people what deserves their attention," said Jeff Bigham, associate professor in the HCII. "Many people use memes, and so they should be made accessible."

Memes largely live within social media platforms that have barriers to adding alt text. Twitter, for example, allows people to add alt text to their images, but that feature isn't always easy to find. Of 9 million tweets the CMU researchers examined, one million included images and, of those, just 0.1 percent included alt text.

Gleason said basic computer vision techniques make it possible to describe the images underlying each meme, whether it be a celebrity, a crying baby, a cartoon character or a scene such as a bus upended in a sinkhole. Optical character recognition techniques are used to decipher the overlaid text, which can change with each iteration of the meme. For each meme type, it's only necessary to make one template describing the image, and the overlaid text can be added for each iteration of that meme.

But writing out what the meme is intended to convey proved difficult.

"It depended on the meme if the humor translated. Some of the visuals are more nuanced," Gleason said. "And sometimes it's explicit and you can just describe it." For example, the complete alt text for the so-called "success kid" meme states "Toddler clenching fist in front of smug face. Overlaid text on top: Was a bad boy all year. Overlaid text on bottom: Still got awesome presents from Santa."

The team also created a platform to translate memes into sound rather than text. Users search through a sound library and drag and drop elements into a template. This system was made to translate existing memes and convey the sentiment through music and sound effects.

"One of the reasons we tried the audio memes was because we thought alt text would kill the joke, but people still preferred the text because they're so used to it," Gleason said.

Deploying the technology will be a challenge. Even if it was integrated into a meme generator website, that alt text wouldn't be automatically copied when the image was shared on social media.

"We'd have to convince Twitter to add a new feature," Gleason said. It could be something added to a personal smartphone, but he noted that would put the burden on the user. CMU researchers are currently working on related projects, including a browser extension for Twitter that attempts to add alt text for every image and could include a meme system. Another project seeks to integrate alt text into the metadata of images that would stay with the image wherever it was posted.

Website search

Recently updated

ZoneAlarm Free Antivirus + Firewall ZoneAlarm Free Antivirus + Firewall The ultimate Internet Security solution that detects and blocks viruses, spyware, Trojan horses, worms, bots as well as rootkits
EG Anti Virus EG Anti Virus Antivirus application with password protection, multiple scan modes, quarantine, data security tools, encrypted notes, and file cleaner
ESET Internet Security (Smart Security) ESET Internet Security (Smart Security) Eset's complete security solution against viruses, spyware, worms and other kinds of malware, backed by a personal firewall, anti-spam, anti-theft and parental control, among other modules

Software News

Jan 24
The headlines on many tech-watching sites this week amounted to one big whaaat? An anti-tracking feature in Apple's Safari browser was actually exposing private browsing habits, according to researchers outside Apple. This ...
Jan 23
Tinder announced Thursday that US users would soon have a "panic button" to alert authorities to potentially dangerous situations as part of a stepped up safety initiative by the popular dating app.
Jan 23
Android is all up in the clouds, just where Canonical thought it could be, in working up its service called Anbox Cloud, announced earlier this week.
Jan 21
Three WordPress plugins have been picking up quite the glare of attention this month after researchers found serious vulnerabilities in them-and the numbers are sobering, in that these plugins have been installed on more ...
Jan 20
Teaching online video game players to save lives, not take them-that is the aim of a new product developed in an unusual collaboration between the creators of the wildly popular Fortnite games and the International Committee ...
Jan 17
Researchers from Dartmouth and the Massachusetts Institute of Technology (MIT) have developed an original approach to flight scheduling that, if implemented, could result in a significant increase in profits for airlines ...
Jan 15
The National Security Agency has discovered a major security flaw in Microsoft's Windows 10 operating system that could allow hackers to intercept seemingly secure communications.

About us

Welcome to new crack resource CrackDownloadz.com! Our service can generate cracks, keygens and serials for your software to unlock it. CrackDownloadz provides a lot of popular cracks and keygens. No spyware and adware at all, just download new cracks, keygens and serials. If you have a software that needs a crack feel free to contact us.

Also you may contact us if you have software that needs to be removed from our website.