Collecting and reporting data

Management of data is not a separate stand-alone process; it is closely linked and guided by the M&E system described in the rest of this section. The data requirements defined through use of the logical framework and indicators, and the activities to ensure the data is available should all form part of the data management processes.

Collecting data

When identifying sources of data or means of verification for indicators, NSPs and partner NGOs/CBOs should identify where sources are secondary sources, and those where systems or tools need to be put in place, as the data sources are primary. It is important for the NSP to provide CBOs formats and guidance for collecting and reporting process data, linked to the activities and programmes they’re implementing. This might require development of data collection or recording tools, where they do not exist for information that has been identified as crucial for monitoring and evaluation. Some of this data will obviously be difficult to track through simple data collection and recording systems, requiring more specialised studies. But most process monitoring data can be tracked through regular data collection and recording systems, e.g. numbers of people trained, IEC materials distributed etc.

Data collected as part of the M&E system should be easily accessible. A good filing system (whether paper or electronic) can help avoid loss of data through disorganisation. Analysing and summarising incoming data on an ongoing basis can help to avoid daunting volumes of information. Staff may require training in the analysis of qualitative and quantitative data.

Reporting

Reporting is an integral part of monitoring and evaluation. Reporting is the systematic and timely provision of essential information at periodic intervals. Reporting is at all levels; CBO/NGOs have to submit regular reports to NSPs, and NSPs to their donors. For those NGOs, CBOs and NSPs who are supported by multiple donors, the process of reporting becomes more complex with the need to report to multiple organisations, who each have different regulations and requirements. Efficient and effective reporting requires that a good M&E system is in place to collect, collate, analyse and document the required information and lessons learned. Programme reports should be linked to the M&E systems, information provided should be based on identified and agreed on indicators from the M&E system

Under the terms of a contract, or Memorandum of Understanding (MOU), between partner NGOs/CBOs and NSPs, NGOs and CBOs are often required to submit a financial and narrative activity report at specified intervals, and disbursement of money may be linked to the receipt and approval of reports. NSPs need to provide their partner organisations with clear guidelines on reporting requirements and work with partners to develop reporting systems so that they are not excessively burdened in this respect. In general, brief and regular reports are easier for CBOs to manage than less frequent larger reports. Providing feedback to partner NGOs or CBOs on submitted reports is often a good opportunity for NSPs to provide technical support on monitoring and evaluation, and documentation.

Issues to consider

  • Reports from partner organisations should include both quantitative and qualitative information. The content and structure of reports should be agreed between the NSP and the partner NGO/CBO, and with donors.
  • Progress reports can include: Summary of achievements, based on planned activities and indicators; Summary of constraints, with explanations of why; Steps taken to correct the situation (if any); Recommendation measures to improve results.
  • NSPs can use the reporting process and the information gained to make decisions about programmatic direction and required technical input.
  • Financial and programmatic reporting require skills, and NGOs and CBOs often need technical support in this area.
  • Partner NGOs and CBOs should be encouraged to use the process of reporting for reflection on their activities and to identify lessons learned. This will help them to improve programmes and input into the collective knowledge about HIV/AIDS.
  • There is often tension from the opposing pressures of needing to submit high quality reports against using the time to implement the project. This is experienced by both NGOs/CBOs and NSP staff It is important for NSPs to highlight and emphasise to their own staff, and that of partner NGOs and CBOs, the importance of reporting in fundraising and donor relations.
  • NSPs can use reports to donors as an advocacy tool to persuade them to support issues that are of importance to NSPs and their partner organisations.
  • Reporting can be useful for reflecting weaknesses and failures as well as highlighting successes. This is important for learning and is most likely to be possible if there is a relationship of trust and openness between NSPs and their partner organisations.
  • Increasingly NGOs are funded by multiple donors and an NSP may only partially fund an NGO’s or CBO’s activities. NSPs will need to consider to what extent they can expect partner organisations to report on activities that might not be directly funded by them but to which they contribute.
  • Often NSPs have more than one donor who requires reporting from the NSP’s partners as part of their monitoring and evaluation process. Different donors may have different timelines and reporting requirements.
  • NSPs and their partners should be synchronised as far as possible to ensure that the burden of information collection, analysis and the preparation of reports is kept to a minimum.

Resources

Presentation of the Alliance New Reporting System

Explains the 6-monthly planning and reporting system used globally by the Alliance.
International HIV/AIDS Alliance, 2005, Powerpoint, 15 pgs, 223 kb

, ,

Narrative Quarterly Reporting Form

Format for reporting activities of linking organisations and documenting technical support received.
Español, Français, Portugues
International HIV/AIDS Alliance, 2000, Word, 8 pgs, 65 kb

,

IDS Policy Briefing, Issue No 12: Participatory Monitoring and Evaluation: Learning from Change

Paper looking at the assumptions behind participatory monitoring and evaluation (PM&E), focusing on lessons learned, accountability and challenges.
Institute for Development Studies, 1998, Word, 6 pgs, 67 kb

Meeting the Behavioural Data Collection Needs of National HIV/AIDS and STD Programmes

Document describing how behavioural data can contribute to planning, execution, and monitoring of HIV prevention activities at national level.
E. Pisani et al, IMPACT/Family Health International/UNAIDS, 1998, PDF, 45 pgs, 138 kb

A Guide to HIV/AIDS Epidemiological and Surveillance Terms

Guide containing a detailed catalogue of HIV/AIDS epidemiological and surveillance terminology.
Canadian AIDS Society (CAS) and Health Canada, 2002, PDF, 98 pgs, 440 kb

Training of the Local Research Team and Data Collection Tools

Toolkit describing the training of the local research team and the preparation for data collection in Burkina Faso for the involvement of people living with HIV/AIDS research study.
HORIZONS/ International HIV/AIDS Alliance, Word, 108 pgs,  364 kb

, ,
, ,

Tool to be used to estimate numbers reached by partner NGOs and CBOs

A tool to help partner organisations estimate the numbers of people reached through their programmes and services.
International HIV/AIDS Alliance, 2002, Excel, 1 pg, 113 kb

, ,

Quick Investigation of Quality (QIQ): A User's Guide for Monitoring Quality of Care in Family Planning

Guidelines on designing and implementing QIQ, to monitor the quality of care in clinic-based family planning programs.
Measure Evaluation Manual Series, no. 2, 2001, PDF, 205 pgs, 530 kb

Information: It's Collection and Use Throughout the Project Cycle

Guidance on collecting and using data from sources such as surveys, PRAs and samples.
W Klaassen & M Moynihan, Network Learning, 2005, PDF, 30 pgs, 747 kb