Lightweight tool boxes clever with heavyweight data

The toolkit, called "dtool," is a suite of software for managing scientific data and making it accessible for front-line researchers working across multiple projects areas.

It works by packaging data and metadata - information that identifies the data - into handy boxes or datasets.

These self-contained packages of data and metadata make it easy to move datasets around and create remote backup copies.

The tools work with both traditional file systems as well as cloud options such as Amazon S3 and Microsoft Azure, allowing researchers to choose the storage solution that best suits their needs and budgets.

The system means researchers can quickly find datasets of interest without the headache of having to access and maintain a central database. The packaged metadata can be used to verify the integrity of the data in the box.

The John Innes Centre team outline the benefits of dtool in an article published in PeerJ - the Journal of Life and Environmental Sciences.

They say the toolkit offers peace of mind because researchers know data underpinning scientific results are safe, searchable and accessible across a highly distributed research environment such as the John Innes Centre.

Dr. Tjelvar Olsson, Senior Scientific Data and Infrastructure Manager at the John Innes Centre, who is one of the creators of the system, said: "At the John Innes Centre we have 40 different research groups dealing with huge volumes of all kinds of data.

"We want more people to use dtool to manage their data. We have designed it in a way that slots into their way of working, a lightweight, solution used in a minimal kind of way that sits on top of what they are already doing."

One of the early adopters of dtool is the team of Dr. Brande Wulff working on disease resistance in wheat at the John Innes Centre.

Advances in technologies such as genetic sequencing and computational systems biology have contributed to an explosion in the volumes and types of data. While this has led to major advances in plant and microbial science it has led to substantial challenges in data management and processing for front line researchers.

Dr. Matthew Hartley, Head of the JIC's informatics team, who helped to devise dtool, said the impact was already being felt.

"Managing data at scale is one of the biggest challenges in computational biological research. dtool has made storing our data cheaper, given us peace of mind and sped up our research.".

More information: Tjelvar S.G. Olsson et al. Lightweight data management with dtool, PeerJ (2019). DOI: 10.7717/peerj.6562

Website search

Recently updated

Bitdefender Total Security 2018 Bitdefender Total Security 2018 Anti-malware solution with anti-theft, anti-phishing, firewall, autopilot, rescue mode, intrusion detection, ransomware protection, parental control, browser sandbox, password manager, and more
eScanAV AntiVirus Toolkit eScanAV AntiVirus Toolkit Analyzes important areas of your computer, such as the registry, system folders, startup items, running services and the memory to detect potential dangerous content
OPSWAT Metadefender Client OPSWAT Metadefender Client Detects potential security threats using multiple antivirus engines and helps you deal with known vulnerabilities, wrapped in a user-friendly interface

Software News

Jul 11
Online virtual worlds can help social movements raise awareness and create safe spaces for their members, according to a new study by an academic at the University of East Anglia (UEA).
Jul 8
The core idea of the team headed by Magdeburg project leader, Professor Dr. Mesut Güne is to develop the self-organizing migration of services. This means that the services-such as home automation, data management, and ...
Jun 27
Video game publisher Electronic Arts has tightened some openings cybersleuths found in its Origin online network that could have exposed more than 300 million video game players to identity theft and account losses.
Jun 26
Achieving a good signal-to-background ratio in neutron scattering experiments is a crucial factor in instrument and sample environment design. However, in current Monte Carlo simulation software, not all neutron interactions ...
Jun 25
Apple will unveil new iPhones in September, assuming the company sticks to its usual playbook. The fall timeframe is also when Apple officially releases the latest flavor of iOS, the software that will not only be at the ...
Jun 19
How would you and your neighbours triple the number of households in your street block in order to keep your cherished suburb thriving and do your bit to tackle urban sprawl? You have a number of choices to make. Where do ...
Jun 16
From the Zen capital of LA to the Champs Elysees comes the calming voice of a British Buddhist monk-turned entrepreneur, introducing American-style online mindfulness to the stressed-out French.

About us

Welcome to new crack resource! Our service can generate cracks, keygens and serials for your software to unlock it. CrackDownloadz provides a lot of popular cracks and keygens. No spyware and adware at all, just download new cracks, keygens and serials. If you have a software that needs a crack feel free to contact us.

Also you may contact us if you have software that needs to be removed from our website.