# Hyperbrowser Deep Research Log — Nigerian Grid Electricity Data

Generated: 2026-06-19T10:06:28.547799

## Directories
- Extracted pages / JSON: `C:\Users\HP\palmgrove\NEFDB\docs\grid_electricity\hyperbrowser`
- Downloaded datasets: `C:\Users\HP\palmgrove\NEFDB\datasets\grid_electricity\hyperbrowser`

## 1. Nigerian Energy Data Bank — primary win

Portal: `https://databank.energy.gov.ng/elect_production_view`

The JS form renders the product-description dropdown and year range dynamically. By inspecting the rendered HTML we identified two undocumented AJAX endpoints used by the page:

- `GET  /elect_production_view/getYearFrom/{product_code}` — returns available years for a code
- `POST /elect_production_view/getResult` — payload: `_token`, `code`, `year_from`, `year_to`

We used those endpoints to fetch all available yearly records for every hydro generation product code.

- Output: `nedb_hydro_generation.csv`
- Records: 180
- Product codes: ELPD_JEBBA_GEN, ELPD_KAINJI_GEN, ELPD_NESCO_GEN, ELPD_SHIRORO_GEN
- Year range: 1962 – 2022

> Note: the portal labels the `value` column unit as `MW`, but the numeric values are annual energy totals (Jebba 1986 ≈ 1.68 million), so the unit should be treated as **MWh** rather than MW.

Captured files:
- `nigeria_energy_databank_elect_production.html` / `.md` / `_links.json` / `_extract.json`
- `nedb_hydro_generation.csv`

## 2. NERC (Nigerian Electricity Regulatory Commission)

Main page and the reports archive (`/resource-category/nerc-reports`) were rendered via Hyperbrowser.
- Annual/quarterly/market reports identified: 10
  - 2025 — NERC Fourth Quarter 2025 Report — https://nerc.gov.ng/wp-content/uploads/2026/04/2025_Q4-Report.pdf
  - 2025 — NERC Third Quarter 2025 Report — https://nerc.gov.ng/wp-content/uploads/2026/01/2025_Q3-Report.pdf
  - 2025 — NERC Second Quarter 2025 Report — https://nerc.gov.ng/wp-content/uploads/2025/10/2025_Q2-Report.pdf
  - 2022 — Annual Report 2022 — https://nerc.gov.ng/wp-content/uploads/2025/09/2022_Annual_Report.pdf
  - 2024 — NERC Annual Report 2024 — https://nerc.gov.ng/wp-content/uploads/2025/07/2024-Annual-Report-1.pdf
  - 2025 — NERC First Quarter 2025 Report — https://nerc.gov.ng/wp-content/uploads/2025/07/2025_Q1_Report.pdf
  - 2024 — NERC Fourth Quarter 2024 Report — https://nerc.gov.ng/wp-content/uploads/2025/03/2024_Q4-Report.pdf
  - 2023 — NERC 2023 Market Competition Report — https://nerc.gov.ng/wp-content/uploads/2024/12/NERC-2023-Market-Competition-Report.pdf
  - 2024 — NERC Third Quarter 2024 Report — https://nerc.gov.ng/wp-content/uploads/2024/12/2024_Q3-Report.pdf
  - 2024 — NERC Second Quarter 2024 Report — https://nerc.gov.ng/wp-content/uploads/2024/10/NERC_2024_Q2_Report.pdf
- PDF reports matching those URLs were downloaded to the datasets folder.
- `nerc_home_extract.json`, `nerc_reports_extract.json`, `nerc_reports.html/.md` saved in docs.
- `/industry-statistics/` returned an HTTP 500 during direct follow-up; not captured.

## 3. TCN (Transmission Company of Nigeria)

`https://tcn.org.ng` and its repository page (`/page_repository.php`) were rendered and downloaded.
- PDF documents captured from the repository: 71 (mostly procurement / tenders, plus AFS 2018–2020 and WAPP notices).
- `tcn_grid_operations.html/.md/_links.json` and `tcn_repository.html/.md/_links.json` saved.
- No extract JSON was produced for the repository before the run timed out; the HTML/link files contain the full page and document URLs.

## 4. NBET / market operator

`https://nbet.com.ng` rendered; the home page links to:
- `Generation Data` — https://nbet.com.ng/generationdata.html
- `Distribution Data` — https://nbet.com.ng/distributiondata.html
- `Annual Market Performance` — https://nbet.com.ng/performance.html
- `Reconciliation & Claw backs` — https://nbet.com.ng/reconciliation.html

`https://nbet.com.ng/generationdata.html` was fetched directly. It currently exposes a single 2020 PSRO Excel file, but the server returns a broken 165-byte response for `pdf/psro.xlsx`.
- `nbet_generation_data.html` saved.

## 5. World Bank DataBank

`https://databank.worldbank.org/source/world-development-indicators` loaded, but it shows the generic empty selection UI (no country/series/time pre-selected). No Nigeria electricity data is visible without UI interaction.

As a fallback we replicated the World Bank REST API the DataBank frontend uses and fetched Nigeria electricity indicators directly:
- Output: `world_bank_nga_electricity_indicators.csv`
- Indicator series: 6
- Rows: 396
- Indicators: EG.ELC.ACCS.ZS, EG.ELC.COAL.ZS, EG.ELC.HYRO.ZS, EG.ELC.NGAS.ZS, EG.ELC.PETR.ZS, EG.ELC.RNEW.ZS
- `world_bank_databank_extract.json` and `world_bank_api_indicators.json` saved in docs.

## 6. IEA data portal

`https://www.iea.org/countries/nigeria` is behind a Cloudflare challenge. Hyperbrowser scrape returned only the `Just a moment...` interstitial; no energy data, charts, or links were extracted. This portal remains blocked for automated extraction.
- `iea_nigeria_portal_extract.json` saved as evidence of the block.

## File inventory

**Docs folder** (24 files):
- `iea_nigeria_portal_extract.json` (504 bytes)
- `nbet_generation_data.html` (12322 bytes)
- `nbet_market_operator_extract.json` (1097 bytes)
- `nerc_annual_reports_extract.json` (889 bytes)
- `nerc_home_extract.json` (582 bytes)
- `nerc_industry_statistics.html` (62284 bytes)
- `nerc_reports.html` (277954 bytes)
- `nerc_reports.md` (23511 bytes)
- `nerc_reports_extract.json` (2206 bytes)
- `nerc_reports_links.json` (5067 bytes)
- `nigeria_energy_databank_elect_production.html` (37962 bytes)
- `nigeria_energy_databank_elect_production.md` (5236 bytes)
- `nigeria_energy_databank_elect_production_extract.json` (5103 bytes)
- `nigeria_energy_databank_elect_production_links.json` (1888 bytes)
- `summary.json` (7696 bytes)
- `tcn_grid_operations.html` (71086 bytes)
- `tcn_grid_operations.md` (5517 bytes)
- `tcn_grid_operations_extract.json` (683 bytes)
- `tcn_grid_operations_links.json` (899 bytes)
- `tcn_repository.html` (101028 bytes)
- `tcn_repository.md` (43556 bytes)
- `tcn_repository_links.json` (21363 bytes)
- `world_bank_api_indicators.json` (86635 bytes)
- `world_bank_databank_extract.json` (1320 bytes)

**Datasets / downloads folder** (83 files):
- CSV files: 2
- PDF files: 81
- Excel files: 0

All downloads (selected list; see folder for complete set):
- `2022_Annual_Report.pdf` (3862406 bytes)
- `2024-Annual-Report-1.pdf` (9647792 bytes)
- `2024_Q3-Report.pdf` (2682455 bytes)
- `2024_Q4-Report.pdf` (2585244 bytes)
- `2025_Q1_Report.pdf` (2570618 bytes)
- `2025_Q2-Report.pdf` (2588173 bytes)
- `2025_Q3-Report.pdf` (2669302 bytes)
- `2025_Q4-Report.pdf` (3006294 bytes)
- `advert_20correted.pdf` (6229273 bytes)
- `AEDC_SUSPENSION_NOTICE.pdf` (714819 bytes)
- `CERTIFICATE_20OF_20COMPLIANCE_20AND_20DISCLAIMER.pdf` (418335 bytes)
- `Consultancy_services_for_I_dependent_Verification_Agent__firm__for_the_Distribution_Sector_Recovery_Program_DISREP.pdf` (2572689 bytes)
- `Consultancy_services_for_Project_Coordinator_for_DISREP.pdf` (486421 bytes)
- `Emergency_20procurement_20of_20Electrical_20Equipment_20Materials_20.pdf` (463039 bytes)
- `Enviro_Data_20_20base_REOI_Ng1_Modif.pdf` (643240 bytes)
- `Environmental_20and_20Social_20Systems_20Assessment_20_ESSA_.pdf` (1405698 bytes)
- `EOI_20-_20Enterprise_20Resource_20Planning-AFD_20review_link_20-_20Final.pdf` (161386 bytes)
- `ESMF_20Report_20for_20DISREP_20docx.pdf` (2224173 bytes)
- `EXPRESSION_20OF_20INTEREST_20FOR_20NETAP_20CONSULTING_20SERVICE.pdf` (94562 bytes)
- `EXTENSION_20OF_20INVITATION_20FOR_20PREQUALIFICATION.pdf` (482354 bytes)
- `INFO_NOTICE.pdf` (486094 bytes)
- `INVITATION_20FOR_20BIDDERS-BUYERS_20FOR_20THE_20DISPOSAL_20OF_20HELICOPTERS_20AND_20SPARE_20PARTS.pdf` (435393 bytes)
- `Invitation_20for_20Expression_20of_20Interest_20as_20Insurance_20Underwriter.pdf` (442507 bytes)
- `INVITATION_20FOR_20TENDER_20FOR_20PERFORMANCE_20CONTRACT_20FOR_20COMPRESHENSIVE_20MAINTENANCE_20OF_20THE_20330kV_20ALAOJI_20IKOTEKPENE.pdf` (443502 bytes)
- `INVITATION_20TO_20TENDER_20FOR_20THE_20CONSTRUCTION_20OF_20391km_20132kV_20DC_20TRX_20LINE_20AND_20FIVE_20132kV_20SUBSTATION_20IN_20JIGAWA_20AND_20KATSINA_20STATE.pdf` (70385 bytes)
- `INVITATION_20TO_20TENDER_20FOR_20THE_20RECONDUCTORING_20OF_20SOME_20TRANSMISSION_20LINES_20WITH_20GAP_20CONDUCTOR.pdf` (433161 bytes)
- `INVITATION_20TO_20TENDER_20FOR_20THE_20SUPPLY_20OF_20SUBSTATION_20EQUIPMENT_20AND_20MAINTENANCE_20MATERIALS.pdf` (60408 bytes)
- `Invitation_for_Initial_Selection_-SCADA.pdf` (1507654 bytes)
- `Invitation_for_Initial_Selection_on_Rehabilitation_of_SCADA_system_in_Transmission_Network.pdf` (2319913 bytes)
- `JICA_20Lag_Ogun_20Project_final_20RFP_rev_2020220415.pdf` (1303101 bytes)
- `JICA_20Preparatory_20Study_20Report_final.pdf` (26873741 bytes)
- `LMP_20_1_.pdf` (811769 bytes)
- `MO_Suspension_Order.pdf` (3638162 bytes)
- `nedb_hydro_generation.csv` (13320 bytes)
- `NERC-2023-Market-Competition-Report.pdf` (1699860 bytes)
- `NERC_2024_Q2_Report.pdf` (3128391 bytes)
- `Notice_20Assistant_20ASSE_20Birni_20Kebbi.pdf` (209798 bytes)
- `NOTICE_20OF_20KEDCO_20SUSPENSION_20LIFT.pdf` (82892 bytes)
- `PROCUREMENT_20NOTICE_20FOR_20CONSULTING_20SERVICES.pdf` (453217 bytes)
- `Procurement_20notice_20for_20Reconductoring_20of_20132kV_20Transmission_20Lines.pdf` (456870 bytes)
- `Procurement_20notice_20on_20Digitization_20of_20Old_20Transmission_20Substation.pdf` (60911 bytes)
- `PROCUREMENT_20NOTICE_20ON_20THE_20CONSTRUCTION_20OF_20JIGAWA_20AND_20KATSINA_20TS.pdf` (661684 bytes)
- `PROCUREMENT_20OF_20COMPUTERS_20AND_20ACCESSORIES_20FOR_20WAPP_20NORTH_20CORE.pdf` (735444 bytes)
- `Procurement_20of_20Consultant_20for_20Supervision_20and_20Management_20of_20a_20Turnkey_20Supply_20and_20Installation_20of_20an_20Integrated_20Suite_20of_20Information_20Systems.pdf` (3124407 bytes)
- `PROCUREMENT_20OF_20TRANSFORMER_20OIL_20FOR_20MAINTENANCE_20OF_20TRANSMISSION_20EQUIPMENT.pdf` (459944 bytes)
- `PUBLIC_NOTICE_ON_FORCE_MAJEURE.pdf` (573260 bytes)
- `publicmajuere.pdf` (1476118 bytes)
- `PublicNotice03-10-2023-63rd-INDEPENDENCE-CELEBRATION.pdf` (2282330 bytes)
- `PublicNotice23-08-23.pdf` (518143 bytes)
- `Recruitment_20Notice_20-_20Nigeria_2.pdf` (234567 bytes)
- `RECRUITMENT_20OF_20TRAINERS_20FOR_20WAPP_20DISPATCHERS.pdf` (522166 bytes)
- `RECRUITMENT_ADVERT_FOR_WAPP_DIRECTOR.pdf` (330553 bytes)
- `Request_20for_20Bid_20-_20April_201_202019.pdf` (1660268 bytes)
- `Request_20for_20bid_20for_20Reconductoring_20of_20132kV_20Transmission_20Lines-Kumbotso-Hadeji_20Kankia.pdf` (456989 bytes)
- `REQUEST_20FOR_20BIDS_20ON_20THE_20SUPPLY_20OF_20TRANSFORMER_20OIL_20REGENERATION_20MACHINE_20CRANE_20AND_20HIAB_20TRUCKS_20TO_20OJO_20STORES_20LAGOS_20STATE.pdf` (451523 bytes)
- `Request_20for_20EOI_20-_2010-02-23.pdf` (2512745 bytes)
- `Request_20for_20EOI_20for_20Engineering_20Supervision_20and_20Site_20Management_20for_20the_20Rehabilitation_20of_20Transmission_20SCADA_20System.pdf` (250664 bytes)
- `REQUEST_20FOR_20EXPRESSION_20OF_20INTEREST_20_CONSULTING_20SERVICES_20FOR_20THE_20NIGERIA_20EXPANSION_20TRANSMISION_20PROJECT_20_NTEP-1_.pdf` (472213 bytes)
- `REQUEST_20FOR_20EXPRESSION_20OF_20INTEREST_20FOR_20ENGAGEMENT_20OF_20INDIVIDUAL_20PROCUREMENT_20CONSULTANT_20NTEPCS1_20FOR_20NTEP1.pdf` (4527727 bytes)
- `Request_for_Expression_of_interest_for_the_Reinforcement_of_High_Voltage_Transmission_Ring_around_Abuja_project._20_2_.pdf` (474500 bytes)
- `RESETTLEMENT_20ACTION_20PLAN_20_RAP_20REPORT_20_LOT_201_.pdf` (10657042 bytes)
- `RESETTLEMENT_20ACTION_20PLAN_20_RAP_20REPORT_20_LOT_202_.pdf` (4666965 bytes)
- `RESETTLEMENT_20ACTION_20PLAN_20_RAP_20REPORT_20_LOT_203_.pdf` (6214478 bytes)
- `SEP_20_1_.pdf` (1481673 bytes)
- `SIGNED_AFS_2018.pdf` (5497848 bytes)
- `SIGNED_AFS_2019.pdf` (1469686 bytes)
- `SIGNED_AFS_2020.pdf` (10978415 bytes)
- `SUPPLY_AND_INSTALLATION_OF_METER_DATA_MANAGEMENT.pdf` (1319184 bytes)
- `TCN_20Tender_20Advert1.pdf` (191259 bytes)
- `TCN_20Tender_20Advert2.pdf` (191259 bytes)
- `TCN_20Tender_20Advert3.pdf` (1882284 bytes)
- `TCN_20Tender_20Advert4.pdf` (125446 bytes)
- `TCN_20Tender_20Advert5_20-_20May_2028_202019.pdf` (135269 bytes)
- `TCN_20Tender_20Advert6_20-_20June_207_202019.pdf` (454867 bytes)
- `TCN_20Tender_20Advert7_20-_20June_2024_202019.pdf` (455920 bytes)
- `TOR_DEF-SOCIO-ENVIRONMENTAL_ASSISTANT-NIGERIA__BK_20DEF.pdf` (186961 bytes)
- `WAPP_20Advert.pdf` (661157 bytes)
- `WAPP_20EXPRESSION_20OF_20INTEREST_20FOR_20330_20kV_20_20MEDIAN_20INTERCONNECTION_20PROJECT.pdf` (593016 bytes)
- `WAPP_20NOTICE_20OF_20INTERNATIONAL_20RECRUITMENT.pdf` (694881 bytes)
- `WAPP_20RECRUITMENT_20NOTICE_20DEF_2017042020.pdf` (522620 bytes)
- `WAPP_3.pdf` (498090 bytes)
- `wapp_fpbw_new.pdf` (525320 bytes)
- `world_bank_nga_electricity_indicators.csv` (34143 bytes)

## What remains blocked / next steps

1. **IEA Nigeria portal** — blocked by Cloudflare challenge. Options: use Hyperbrowser with a live browser session + Playwright to wait/solve the challenge, or subscribe to IEA data services.
2. **World Bank DataBank interactive UI** — needs country/series/time selection. Could be automated through a live browser session or by directly calling the WDI API (already demonstrated).
3. **NBET generation data** — the 2020 PSRO Excel link is broken on the server. Newer NBET market data may be available through an authenticated portal or direct contact.
4. **NERC industry statistics page** — returned HTTP 500 during this run; retry or use the direct report PDFs already captured.
5. **TCN repository** — many documents are procurement notices. The annual financial statements (`SIGNED_AFS_2018/2019/2020.pdf`) were downloaded; operational generation dashboards were not found.

## Method notes

- Hyperbrowser Scrape + Extract APIs were used for JS-heavy/render-dependent portals.
- Direct HTTP calls were used for the discovered NEDB AJAX endpoints and the World Bank API.
- Downloaded files were saved directly from link URLs found in the rendered pages.