• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

AI Helps Discover New Space Anomalies

AI Helps Discover New Space Anomalies

© iStock

The SNAD team, an international network of researchers including Matvey Kornilov, Associate Professor of the HSE University Faculty of Physics, has discovered 11 previously undetected space anomalies, seven of which are supernova candidates. The researchers analysed digital images of the Northern sky taken in 2018 using a k-D tree to detect anomalies through the ‘nearest neighbour’ method. Machine learning algorithms helped automate the search. The paper is published in New Astronomy.

Most astronomical discoveries have been based on observations with subsequent computations. While the total number of observations in the 20th century was still relatively small, the volumes of data drastically increased with the arrival of large-scale astronomical surveys. For example, the Zwicky Transient Facility (ZTF), which uses a wide-field view camera to survey the Northern sky, generates ∼1.4 TB of data per night of observation and its catalogue contains billions of objects. Manually processing such enormous amounts of data is both expensive and time consuming, so the SNAD team of researchers from Russia, France and the US came together to develop an automated solution.

When scientists examine astronomical objects, they observe their light curves, which show variations of an object’s brightness as a function of time. The observers first identify a flash of light in the sky and then follow its evolution to see whether the light becomes brighter or weaker over time, or goes out. In this study, the researchers examined a million real light curves from the ZTF's 2018 catalogue and seven simulated live curve models of the types of objects under study. In total, they followed some 40 parameters, including the amplitude of an object's brightness and the timeframe. 

Konstantin Malanchev, co-author of the paper and postdoc at the University of Illinois at Urbana-Champaign

'We described the properties of our simulations using a set of characteristics expected to be observed in real astronomical bodies. In the dataset of approximately a million objects, we were looking for super-powerful supernovae, Type Ia supernovae, Type II supernovae, and tidal disruption events. We refer to such classes of objects as anomalies. They are either very rare, with little-known properties, or appear interesting enough to merit further study.'

The light curve data from real objects was then compared to that of simulations using the k-D tree algorithm. A k-D tree is a geometric data structure for splitting space into smaller parts by cutting it with hyperplanes, planes, lines or points. In the current research, this algorithm was used to narrow down the search range when looking for real objects with properties similar to those described in the seven simulations.

Subsequently, the team identified 15 nearest neighbours, ie real objects from the ZTF database, for each simulation—105 matches in total, which the researchers then examined visually to check for anomalies. The manual verification confirmed 11 anomalies, of which seven were supernova candidates, and four were active galactic nuclei candidates where tidal disruption events could occur. 

Maria Pruzhinskaya, a co-author of the paper and research fellow at the Sternberg Astronomical Institute

'This is a very good result. In addition to the already-discovered rare objects, we were able to detect several new ones previously missed by astronomers. This means that existing search algorithms can be improved to avoid missing such objects.'

This study demonstrates that the method is highly effective, while relatively easy to apply. The proposed algorithm for detecting space phenomena of a certain type is universal and can be used to discover any interesting astronomical objects, not limited to rare types of supernovae. 

Matvey Kornilov, Associate Professor of the HSE University Faculty of Physics

'Astronomical and astrophysical phenomena which have not yet been discovered are in fact anomalies. Their observed manifestations are expected to differ from the properties of known objects. In the future, we will try using our method to discover new classes of objects.'

See also:

‘In the Future, I Expect Rapid Development of Professions Related to Prompt Engineering’

The English-language programme of HSE Online ‘Master of Computer Vision’ will change its name to ‘Artificial Intelligence and Computer Vision’ in 2024. Andrey Savchenko, the programme academic supervisor, shares how the new name will affect the programme semantics, why AI has become the main federal trend in the field of information technology, and what tasks graduates will solve.

Artificial Intelligence as a Driver of Digital Transformation

In December, the HSE Institute for Statistical Studies and Economics of Knowledge and the HSE AI Research Centre participated in UNCTAD eWeek to discuss the future of the emerging digital economy. One of the topics discussed during the conference was artificial intelligence and its applications in driving the digital transformation of industry sectors. The session was co-organised by HSE University.

HSE University Receives Highest Grant under Priority 2030 Programme

HSE University has proved its leading position in the first group of the ‘Research Leadership’ field under the Priority 2030 programme. The university has also received the highest grant for teaching digital competencies to students, demonstrating its educational leadership in the fields of digital technologies and AI.

‘The Future Lies with AI Technologies and HSE University Understands That’

At the AI Journey 2023 international conference in Moscow, a ranking of Russian universities that train the best AI specialists was published. HSE University entered the A+ leadership group, taking first place according to such criteria as ‘Demand for hiring graduates’, ‘Quality of educational environment’, and ‘Activities for the development of school education’. Ivan Arzhantsev, Dean of HSE University’s Faculty of Computer Science, spoke to the HSE News Service about how AI specialists are trained at HSE University and what plans the university has in this area.

‘Every Article on NeurIPS Is Considered a Significant Result’

Staff members of the HSE Faculty of Computer Science will present 12 of their works at the 37th Conference and Workshop on Neural Information Processing Systems (NeurIPS), one of the most significant events in the field of artificial intelligence and machine learning. This year it will be held on December 10–16 in New Orleans (USA).

Specialists from the HSE Institute of Education Confirm GigaChat’s Erudition in Social Sciences

A multimodal neural network model by Sber, under the supervision of HSE University’s expert commission, has successfully passed the Unified State Exam in social studies. GigaChat completed all exam tasks and scored 67 points.

HSE University Students Win in the AIJ Science Competition at AI Journey 2023

The International Sber Conference of Artificial Intelligence, ‘AI Journey 2023’ recently took place in Moscow. Alexander Rogachev, doctoral student of the HSE Faculty of Computer Science, and Egor Egorov, an HSE 4th-year undergraduate student became the winners of the AIJ Science competition for scientific articles on artificial intelligence that was held as part of the event. The research was carried out under the umbrella of the HSE's Laboratory of Methods for Big Data Analysis (LAMBDA).

HSE University Hosts Fall into ML 2023 Conference on Machine Learning

Over three days, more than 300 conference participants attended workshops, seminars, sections and a poster session. During panel discussions, experts deliberated on the regulation of artificial intelligence (AI) technologies and considered collaborative initiatives between academic institutions and industry to advance AI development through megaprojects.

Child Ex Machina: What Artificial Intelligence Can Learn from Toddlers

Top development teams around the world are trying to create a neural network similar to a curious but bored three-year-old kid. IQ.HSE shares why this approach is necessary and how such methods can bring us closer to creating strong artificial intelligence.

‘My Research Has Evolved into A Broader and More Encompassing Vision’

Seungmin Jin, from South Korea, is researching the field of Explainable AI and planning to defend his PhD on ‘A Visual Analytics System for Explaining and Improving Attention-Based Traffic Forecasting Models’ at HSE University this year. In September, he passed the pre-defence procedure at the HSE Faculty of Computer Science School of Data Analysis and Artificial Intelligence. In his interview for the HSE News Service, he talks about his academic path and plans for the future.