Getting Started with the LAT
If you're just getting started at working with the Fermi satellite, this page aims to provide a single location summarizing the information you will need. However, understanding the Fermi mission, the LAT instrument, and the full scope of data analysis will require a much more thorough investigation of this site than can be provided in a single overview. We urge users to take the time to read, and to ask questions, in order to gain a fuller understanding of the benefits and limitations of the LAT data.
Here are some things to know before working with LAT data. Detailed discussions of most of these terms are available in the Cicerone, with the appropriate page linked at the end of each bullet.
- The LAT instrument records discrete events, individual readouts that are compared with simulations to generate the reconstructed direction and reconstructed energy for each event. These events are stored in the LAT events files, which serve as the primary data files. Event files come in two flavors; photon and extended files, where the extended files contain additional information about each event. The position and orientation information for the spacecraft is provided at 30-second intervals in the spacecraft file. Most analyses require both event and spacecraft files. The spacecraft file must cover the entire time range included in the events file (LAT Data Products).
- The LAT team determines the quality of each event (how likely is it to be a well-reconstructed gamma ray). They use these quality parameters to separate the data into event classes, which are selected with specific performance parameters: transient class has the most background, moving through source, clean, and finally ultraclean class with the least background. Be aware that the reduction in background comes with a corresponding drop in statistics. So most analysis types will strike a balance (LAT Performance Page).
- In addition, a second set of quality parameters allow you to refine your data selection based on specific characteristics. These event types divide the full data set into subsets based on the conversion layer (FRONT and BACK), the quality of the position reconstruction (PSF0, PSF1, PSF2 and PSF3), and the quality of the energy reconstruction (EDISP0, EDISP1, EDISP2 and EDISP3). The PSF and EDISP event types are separated into quartiles, with the best quartile being number 3. Each subdivision of data uses a different instrument response function. You absolutely cannot mix results for data that has been filtered using different flavor event types.
- When you filter data based on information in the events or spacecraft files, you are making cuts to the data. We have provided a recommendation for cuts that are appropriate for a variety of standard analyses (LAT Data Preparation).
- The reconstruction and/or simulation information gets revised every few years to improve the quality of the data. A change in the event reconstruction or the parameters used to generate the event classes is known as a pass, and an improvement in the fidelity of the instrument response is a version. So, for example, P7_SOURCE_V6 refers to source class data that has used the Pass7 reconstruction, and version 6 of the instrument response function. A change in the version affects ONLY the instrument response, and does not affect the underlying data reconstruction or event class designation (LAT IRFs).
- The auxiliary analysis files, such as the Galactic diffuse and isotropic diffuse models are also dependent on the instrument performance. So you should be careful to ensure that you are working with a consistent set of data, models, and IRFs. The file and IRF naming conventions have been designed to help you (LAT Background Models).
There is an abundance of information available to you, including documentation and high-level data products. Here are some items that may be useful for you, and are worth reviewing before diving into the data analysis:
- Most Recent Source Catalogs:
- Quick-Look Data Products:
- Available documentation:
- Cicerone — In-depth discussion of the mission, the instruments, the data and the analysis methods.
- Analysis Overview — High-level description of the individual Fermitools and their use in standard analyses.
- Reference Manual — Online versions of the fhelp (man page) for each tool.
- Analysis Threads — Cookbook-like examples of various analyses designed to walk you through the process step-by-step.
- The talks and tutorials from the Fermi Summer Schools are an excellent resource: 2011, 2012, 2013, 2014, and 2015.
Starting Data Analysis
The instructions below assume you are planning to analyze LAT data from the most recent data release with the most up-to-date information. If you wish to do a non-standard analysis using older data or analysis products, these links might not be appropriate for you.
- Download and install any user-contributed tools or other non-Fermi tools you plan to use:
- All users are likely to want to use the XML model generation python script (download).
- For python users, the LAT analysis scripts are very useful, as are the SED scripts (download).
- For those doing time-consuming tasks, the multi-processor tools (download) may help speed things up.
- XSPEC users may wish to use the LATspec tool (download) to generate XSPEC-compatible spectra.
- The FitsViewer (fv) tool is useful for looking at the contents of a FITS file.
- The FTOOLS are often used for FITS file manipulation.
- SAO's ds9 image viewer can be very helpful for looking at FITS images.
- There are several places to download your data. (Data are usually available less than 24 hours after being acquired):
- The LAT Data Server is used for traditional position queries.
NOTE: Due to size limitations, the LAT Data Server only contains the source, clean, and ultraclean event classes.
- You can also get All-sky Weekly Photon Files (source class or better) from the FTP site.
- The FTP site also has All-sky Weekly Extended Files, which are the only data files available that contain transient class events (for GRB analysis).
NOTE: Weekly files can be easily downloaded from the command line using wget. Check the FAQ for the instructions.
- Specialized GRB analyses may use the LAT Low Energy event files, rather than the standard event files.
- Be sure to review the Data Caveats that the LAT team has provided accompanying each data set. You should review these prior to using LAT results in scientific publications. IMPORTANT!
- You should also review the Temporal Caveats to be sure an apparent signal in your data is not due to mission-related periodic effects.
- Don't forget to grab a spacecraft file:
- Collect any auxiliary analysis files you may need. Many of these files are also available in the refdata directory in your Fermitools Installation ($FERMI_DIR/refdata/fermi/galdiffuse/).
- Background model files: You will need a Galactic diffuse model (description), as well as the isotropic diffuse model appropriate to your data set.
- You will likely need to get the most recent Extended Sources Templates (download zip file). These templates are usually needed when analyzing a long duration dataset near the Galactic plane, or near the three extragalactic extended sources (LMC, SMC, and CenA).
- You may want to include a custom template (decription) in your analysis to account for emission from the Sun (download model) or the Moon (download model). There are detailed instructions on how to construct that template file.
- You may want to use the Earth Limb template (available from the 4-year Catalog page). This model is strictly for point source analysis using the 4-year dataset, and so is unlikely to be useful for most analyses.
- Review analysis instructions appropriate for the science you are planning, as well as the data usage notes specific to your data set (Pass 8, Pass 7 Reprocessed, Pass 7). The most common analysis types are:
- Be sure to review the current Recommended Cuts from the LAT team for your type of analysis. IMPORTANT!
- Additional Analysis Threads are available with cookbook-like examples for a wide variety of analyses.
The LAT normally operates in all-sky scanning mode rocking north and south on alternating orbits. This nominal sky-survey mode acquires ∼30 minutes of exposure every 3 hours for every point on the sky with reasonably constant exposure. However, there are other types of observations that are used to enhance exposure on a variety of targets. Timelines are planned three weeks into the future, and are planned on Mission Week boundaries (Thursday to Wednesday, in UTC). Timelines are posted publicly as soon as they have been scheduled. Any desired changes to the future observing schedule should be addressed through the GI process (for long term or large-scale observing changes), or as a TOO (for rapid-response within the current observing cycle).
Here are some resources to find out what the LAT has been observing, and where it will be pointing in the future, to help coordinate observations at other wavebands.
- Observatory Timelines: Current and future planned timelines (by mission week)
NOTE: You can convert date to/from mission week by using the xTime utility.
- Targets of Opportunity:
- Request for coordinated multi-wavelength observations
NOTE: If you provide your schedule for multi-wavelength observations, the Fermi project will consider the impact on your planned program before approving TOO observations.
The Guest Investigator Program
Proposals for the Fermi Guest Investigator program are usually due mid-January each year. The program funds many different areas of science — data analysis, theory development, multi-wavelength studies, etc. — as long as they can be shown to reasonably relate to the Fermi mission's science goals.
The FSSC hosts a number of newsletters that can help you stay in touch with Fermi-related news. Most are very low-frequency, contacting you only when something important needs to be shared (meeting announcements, new software release, etc.). Here are the links to sign up:
fermi-news — General news about the Fermi mission, meeting announcements, etc.
fermi-soft — Updates on the analysis software and science data.
fermi-papers — Updates on Fermi related papers. (This list sends frequent emails!)
gamma-mw — Information on multi-wavelength observations relevant to Fermi.
As always, if you have any questions about Fermi data or analysis, first check the FAQ. If your question is not addressed there, please contact the Helpdesk, and we'll get back to you as quickly as possible.
Last updated by: Elizabeth Ferrara 5/21/2015