Jump to content

European Grid Infrastructure

From Wikipedia, the free encyclopedia
(Redirected from DataGrid)

EGI
Company typeScientific support
Industry
Founded2010
HeadquartersScience Park 140 1098 XG,
Amsterdam
,
The Netherlands
Area served
Europe
Key people
Revenue6,130,989 Euro (2023) Edit this on Wikidata
Websiteegi.eu

EGI is a federation of computing and storage resource providers that deliver advanced computing and data analytics services for research and innovation. The Federation[1] is governed by its participants represented in the EGI Council and coordinated by the EGI Foundation.

As of 2024, the EGI Federation supports 160 scientific communities worldwide and over 95,000 users in their intensive data analysis. The most significant scientific communities supported by EGI in 2022 were Medical and Health Sciences, High Energy Physics, and Engineering and Technology. The EGI Federation provideds services through over 150 data centres, of which 25 are cloud sites, in 43 countries and 64 Research Infrastructures (4 of which are members of the Federation).

Name

[edit]

Originally, EGI stood for European Grid Infrastructure. This reflected its focus on providing access to high-throughput computing resources across Europe using Grid computing techniques. However, as EGI's service offerings expanded beyond traditional grid computing, particularly with the incorporation of federated cloud services, the original meaning of the acronym became less accurate.

To emphasise the broader scope of EGI's services and avoid any confusion associated with the outdated term "grid," it is recommended to refer to EGI simply as EGI.

Structure

[edit]

EGI Federation

[edit]

The EGI Federation delivers a scalable digital research infrastructure (e-infrastructure), empowering tens of thousands of researchers across diverse scientific disciplines. Through the EGI Federation, researchers gain access to advanced computing and data analytics capabilities, including large-scale data analysis, while benefiting from the collaborative efforts of hundreds of service providers from both public and private sectors, consolidating resources from Europe and beyond. Overall, the EGI Federation offers a range of services, encompassing distributed high-throughput computing and cloud computing, storage and data management capabilities, co-development of new solutions, expert support, and comprehensive training opportunities. This ecosystem propels collaboration, scientific progress and innovation.

EGI Foundation

[edit]

The EGI Foundation is the coordinating body of the EGI Federation. It was established in 2010 with headquarters in Amsterdam, Netherlands. The Foundation coordinates the research and innovation efforts of its members, spanning technical areas critical to data-intensive science, including large-scale data processing and analysis, distributed AI/ML, federated Identity and access management and the application of digital twins for research. The day-to-day running of the EGI Foundation is supervised by the Executive Board. The board’s members work closely with the EGI Director on operational, technical and financial issues. The Executive Board’s members are appointed by the EGI Council for a two-year term.

EGI Council

[edit]

The EGI Council is responsible for defining the strategic direction of the EGI Federation. The Council acts as the senior decision-making and supervisory authority of the EGI Foundation, with a mandate to define the strategic direction of the entire EGI ecosystem.

EGI Services

[edit]

EGI offers a suite of services[2] to support data-intensive research. These services include compute resources, orchestration tools, storage and data management solutions, training programmes, security and identity services, and applications. Compute resources encompass cloud compute, cloud container compute, high-throughput compute, and software distribution. Orchestration tools include the Workload Manager and infrastructure manager. Storage and data management solutions include online storage, data transfer, and DataHub. Training programmes cover FitSM, ISO 27001, and general training infrastructure. EGI Check-in and Secrets Store are key security and identity services, while applications such as Notebooks and Replay enhance research productivity. In addition to services for Research, EGI also provides services for Federation and Business. Services for Federation are designed to help resource providers and user communities collaborate and share resources. EGI also offers a range of services to support businesses in their digital transformation. Through the EGI Digital Innovation Hub (EGI DIH),[3] companies can access advanced computing resources, networking, funding and training opportunities, collaborate with research institutions, and test solutions before investing.

History

[edit]

In 2002, the first large-scale experimental facility was successfully demonstrated by the DataGrid project[4] under the lead of CERN with tens of technical architects from the major High Energy Physics institutes in the world. For the first time, distributed computing was applied to data-intensive processing. It aimed at developing a large-scale computational grid to facilitate distributed data-intensive scientific computing across High Energy Physics, Earth Observation, and Biology science applications.

On 28 February 2003, the first software release of LCG-MW was published. gLite,[5] the Lightweight Middleware for Grid Computing and LCG, Large Hadron Collider Computing Grid, are the cornerstone of the Worldwide LHC Computing Grid, which expanded over time towards the EGI Federation.

2004 marks the year of the first pilot infrastructure, seeing the participation of CERN and data centres in the United Kingdom, Spain, Germany, the Netherlands, France, Canada, Russia, Bulgaria, the Asia-Pacific region and Switzerland. Over the years, the infrastructure has grown into a federation of 128 data centres and 25 cloud providers serving more than 95,000 users worldwide.[6] In 2004, the first data processing tasks started being formally recorded in a central accounting system. The EGI Accounting Portal[7] provides the accounting data for Compute, Storage and Data services gathered from the data centres of the EGI Federation.

A few years later, in 2010, EGI[8] was established as the coordinating body of the EGI Federation to build an integrated pan-European infrastructure to support European research communities primarily. In the same year, EGI launched the flagship project EGI Inspire.[9] That project brought together European organisations to establish a sustainable European Grid Infrastructure for large-scale data analysis. The success of the project was due to the adoption of a distributed computing model to solve big data problems. Moreover, EGI-Inspire harmonised operational policies across its federation of affiliated data centres and cloud service providers worldwide, integrating e-infrastructures from 57 countries. The EGI Federation was the first to apply federation to cloud provisioning,[10] opening a new avenue in large-scale interactive data analysis. In 2015, within EGI Engage,[11] opening a new avenue in large-scale interactive data analysis. The EGI Federated Cloud is an IaaS-type cloud, incorporating academic and private clouds and virtualised resources built using open standards. Its development is driven by the needs of the scientific community, resulting in a novel research e-infrastructure that relies on well-established federated operational services, making EGI a dependable resource for scientific endeavours. In 2015, EGI, EUDAT, GÉANT, LIBER and OpenAIRE published a position paper[12] on a 'European Open Science Cloud for Research'. With the EOSC-hub project[13] in 2016, EGI started contributing in practice to shaping the services for the EOSC. The work continued with a series of projects, like EOSC Enhance,[14] EOSC Life[15] and EOSC Synergy.[16] With EGI-ACE[17] and its contribution to EOSC Future,[18] EGI has continued developing the EOSC Core. In early 2024, EGI started providing services to the EOSC EU Node,[19] and with EOSC Beyond[20] it will provide new EOSC Core capabilities and pilot additional national and thematic nodes. In October 2024, EUDAT, GÉANT, OpenAIRE, PRACE and EGI signed a Memorandum of Understanding establishing the European e-Infrastructures Assembly.[21] This collaboration will bolster the position and promote the services of e-Infrastructures, empowering researchers across Europe to drive innovation and advance scientific discovery.

See also

[edit]

References

[edit]
  1. ^ "EGI Federation". EGI. Retrieved 3 December 2024.
  2. ^ "EGI Services". EGI. Retrieved 3 December 2024.
  3. ^ "EGI DIH". EGI. Retrieved 3 December 2024.
  4. ^ "Research and Technological Development for an International Data Grid". Cordis. European Commission. 2001–2003. Retrieved 3 December 2024.
  5. ^ Ilaria Fava, Maarten Litmaath (30 August 2023). "20 years with EGI: an interview with Maarten Litmaath". EGI. Retrieved 3 December 2024.
  6. ^ "EGI Annual Report 2023". EGI. 30 May 2024. doi:10.5281/zenodo.11393415' (inactive 9 December 2024). Retrieved 3 December 2024.{{cite news}}: CS1 maint: DOI inactive as of December 2024 (link)
  7. ^ "EGI Accounting Portal". EGI Accounting. EGI. Retrieved 3 December 2024.
  8. ^ "EGI.eu statutes". documents.egi.eu. EGI. 8 February 2010. Retrieved 3 December 2024.
  9. ^ "EGI Inspire". Cordis. European Commission. 22 May 2015. Retrieved 3 December 2024.
  10. ^ "EGI Launches Federated Cloud for European Researchers". HPCwire. 24 May 2014. Retrieved 3 December 2024.
  11. ^ "Engaging the EGI Community towards an Open Science Commons". Cordis. European Commission. Retrieved 3 December 2024.
  12. ^ EUDAT, LIBER, OpenAIRE, EGI, GEANT (30 October 2015). "Position Paper: European Open Science Cloud for Research". Zenodo. doi:10.5281/zenodo.32915. Retrieved 3 December 2024.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  13. ^ "Integrating and managing services for the European Open Science Cloud". Cordis. European Commission. Retrieved 3 December 2024.
  14. ^ "Enhancing the EOSC portal and connecting thematic clouds". Cordis. European Commission. Retrieved 3 December 2024.
  15. ^ "Providing an open collaborative space for digital biology in Europe". Cordis. European Commission. Retrieved 3 December 2024.
  16. ^ "European Open Science Cloud - Expanding Capacities by building Capabilities". Cordis. European Commission. Retrieved 3 December 2024.
  17. ^ "EGI Advanced Computing for EOSC". Cordis. European Commission. Retrieved 3 December 2024.
  18. ^ "EOSC Future". Cordis. European Commission. Retrieved 3 December 2024.
  19. ^ "European Open Science Cloud - EU Node". European Open Science Cloud - EU Node. European Commission. Retrieved 3 December 2024.
  20. ^ "EOSC Beyond: advancing innovation and collaboration for research". Cordis. European Commission. Retrieved 3 December 2024.
  21. ^ "European e-Infrastructures Announce Collaboration to Strengthen Research Support". PRACE. 3 October 2024. Retrieved 3 December 2024.
[edit]
Retrieved from "https://wiki.riteme.site/w/index.php?title=European_Grid_Infrastructure&oldid=1262132892#History"