PATC: Managing distributed data with Hecuba and dataClay

Date: 30/Jan/2020 Time: 09:30 - 18:00

Place:
The course will take place in Barcelona Supercomputing Center, within the UPC Campus Nord premises.
Vertex Bulding, Room VS208

Cost: There is no registration fee. The attendees would need to cover the expenses for travel, accommodation and meals.

Primary tabs

Objectives

The objective of this course is to give an overview of BSC storage solutions, Hecuba and dataClay. These two platforms allow to easily store and manipulate distributed data from object-oriented applications, enabling programmers to handle object persistence using the same classes they use in their programs, thus avoiding time consuming transformations between persistent and non-persistent data models. Also, Hecuba and dataClay enable programmers to transparently manage distributed data, without worrying about its location. This is achieved by adding a minimal set of annotations in the classes.

Both Hecuba and dataClay can work independently or integrated with the COMPSs programming model and runtime to facilitate parallelization of applications that handle persistent data, thus providing a comprehensive mechanism that enables the efficient usage of persistent storage solutions from distributed programming environments.

Both platforms offer a common interface to the application developer that facilitates using one solution or the other depending on the needs, without changing the application code. Also, both of them have additional features that allow the programmer to take advantage of their particularities.

Requirements

Basic programming skills in Python and Java.

Previous attendance to PATC course on programming distributed systems with COMPSs is recommended.

Learning Outcomes

In the course, the Hecuba and dataClay syntax, programming methodology and an overview of their internals will be given. Also, an overview of COMPSs at user level will be provided in order to take advantage of the distribution of data with both platforms. The attendees will get a first lesson about programming with the common storage interface that will enable them to start programming with both frameworks.

A hands-on with simple introductory exercises will be also performed for each platform, with and without COMPSs to distribute the computation. The students who finish this course will be able to develop simple Hecuba and dataClay applications and to run them both in a local resource and in a distributed platform (initially in a private cloud)

Academic Staff

Course Conveners

Department and Research group: Computer Science - Workflows and Distributed Computing

Yolanda Becerra, Data-driven Scientific Computing research line, Senior researcher
Anna Queralt, Distributed Object Management research line, Senior researcher

Course Lecturers

Department and Research group: Computer Sciences - Workflows and Distributed Computing

Alex Barceló, Distributed object Management research line, Researcher
Yolanda Becerra, Data-driven Scientific Computing research line, Senior researcher

Adrián Espejo, Data-driven Scientific Computing research line, Junior research engineer
Daniel Gasull, Distributed object Management research line, Research engineer
Pol Santamaria, Data-driven Scientific Computing research line, Junior developer
Anna Queralt, Distributed object Management research line, Senior researcher

Materials

INTELLECTUAL PROPERTY RIGHTS NOTICE:

• The User may only download, make and retain a copy of the materials for his/her use for non‐commercial and research purposes.

• The User may not commercially use the material, unless has been granted prior written consent by the Licensor to
do so; and cannot remove, obscure or modify copyright notices, text acknowledging or other means of identification or disclaimers as they appear.

• For further details, please contact BSC‐CNS patc@bsc.es

Further information

PLEASE BRING YOUR OWN LAPTOP.

NOTE: PATC courses do not charge fee

Recommended Accomodation:

Please follow the link for map of some local hotels.