Push Fronius log data from the past into PV Output?

[jonnoc]

Thanks very much for that with the changes mentioned it seems to be working now, eg, snips from morning, midday and evening

Time	Energy Generated	Power Generated	Energy Consumed
2:00	0	0	891
2:05	0	0	914
2:10	0	0	939
2:15	0	0	977
2:20	0	0	1021
2:25	0	0	1064
2:30	0	0	1107
2:35	0	0	1150
2:40	0	0	1188
2:45	0	0	1220
2:50	0	0	1252
2:55	0	0	1277
3:00	0	0	1310
12:00	21427.55111	5404.016556	9468.551111
12:05	21946.20861	6286.757576	9570.208611
12:10	22423.79139	5693.039735	9681.791389
12:15	22948.13722	6355.707071	9791.137222
12:20	23486.02361	6411.890728	9919.023611
12:25	24021.57472	6491.52862	10041.57472
12:30	24569.65056	6533.354305	10173.65056
12:35	25107.46861	6519.006734	10295.46861
12:40	25633.77139	6358.020134	10426.77139
12:45	26079.42583	5294.90429	10552.42583
12:50	26355.09889	3341.491582	10661.09889
12:55	26878.86028	6243.513245	10774.86028
20:00	42566.14361	0	25697.14361
20:05	42566.14361	0	25848.14361
20:10	42566.14361	0	26152.14361
20:15	42566.14361	0	26484.14361
20:20	42566.14361	0	26695.14361
20:25	42566.14361	0	26845.14361
20:30	42566.14361	0	26999.14361
20:35	42566.14361	0	27151.14361
20:40	42566.14361	0	27301.14361
20:45	42566.14361	0	27437.14361
20:50	42566.14361	0	27563.14361
20:55	42566.14361	0	27651.14361
21:00	42566.14361	0	27724.14361

Sorry this might be a silly question but is it at all possible to also include in the data ‘exported’ and ‘consumption’ as it seems the current ‘energy consumed’ is a total of something? I might have a read through your script and try understand how it all works to get a better idea of what’s possible and how it matches up to the Fronius API…etc…

Appreciate all your work and help!
Cheers!

[grannos]

Hi @jonnoc.

The exported columns were chosen to be in the correct format for the PVO LIveLoader Bulk Loading — PVOutput documentation. Both Energy values are cumulative and PVO expects cumulative figures.

If you’d like to see the 5 minutely interval figures it would be a fairly straightforward exercise to subtract one 5 minutely figure from its successor.

The script achieves a similar thing by preserving the starting MIDNIGHT figure and subtracting it from each of the successive amounts. You could simply subtract adjacent cumulative figures.

The $EnergyReal_WAC_Minus_Absolute and $EnergyReal_WAC_Plus_Absolute values represent the energy flowing through the Smart Meter.

	if ( $x == 0 ) 
		{
		$startMinus = $EnergyReal_WAC_Minus_Absolute;
		$startPlus =  $EnergyReal_WAC_Plus_Absolute;
		}	

The meter itself reports cumulative lifetime figures whereas the script is designed to generate daily cumulative figures. The script generated energy fields therefore start at 0Wh each day.

grannos

[jonnoc]

All worked great, thanks for all your help…

Now the next project trying to export all the daily data as far back as I can to add it to my profile as I already hit the 14-day limit but at least I have a little more history in the system now…

[Decibel]

Thank you grannos much appreciated and saved yours of manual entry

[yeukta]

Hi Grannos, just wanted to say thanks for your script, as I’ve used it to recover and upload a couple of days of missing data. Cheers, Tim

[grannos]

Hi Tim,

Thanks for the feedback. I’m glad see that it’s still getting some use.

Grannos

[Decibel]

I tried adding Voltage to the printout, but I am doing something wrong:

Voltage_AC_Phase_1 248.9

The above is what I see when I interrogate the inverter for the channel.

I added it to the URL Grab as:
…lute&Channel=PowerReal_PAC_Sum&Channel=Voltage_AC_Phase_1";

Added the extra label:
echo “Time,Energy Generated,Power Generated,Energy Consumed, Voltage\n”;

But I am not sure how to format it in the array section:

$Voltage_AC_Phase_1 = $arr[“Body”][“Data”]["meter:IME - Smart Meter 63A-1 - " . $meterSerial][“Data”][“Voltage_AC_Phase_1”][“Values”][$x];

AS it is not happy when it tries to pull as it does not seem to find a voltage value:

Warning: Undefined array key “Voltage_AC_Phase_1” in D:\Data\Documents\Solar\getFroniusArchiveData.php on line 45

Warning: Trying to access array offset on value of type null in D:\Data\Documents\Solar\getFroniusArchiveData.php on line 45

Warning: Trying to access array offset on value of type null in D:\Data\Documents\Solar\getFroniusArchiveData.php on line 45
00:40,0,0,281

[grannos]

Hi,

I just tested the CURRENT version of my script against my Symo. I ran it on my iMac using PHP 8.2.12. Both my inverter and Fronius Smart Meter have the latest firmware. I had to make and modifications to the script for quite some time. The same rules apply regarding altering the IP address and required extraction date.

I will re-post the entire script below. The CURRENT script extracts and reports Voltage_AC_Phase_1 AND Temperature_Powerstage by default as I log both of these to PVO.

16:30,29300.149722222,1615.734006734,5351.1497222222,1016.366,640.489,1656.855,50,241.3

16:35,29430.321944444,1577.8451178451,5391.3219444445,962.25,652.176,1614.426,49,241.2

[EDIT]I was able to extract data from the 1st of May 2023 but not the 1st of April 2023 so it is possible to go back quite a few months.[/EDIT]

[grannos]

<?php
/*

{
   "APIVersion" : 1,
   "BaseURL" : "/solar_api/v1/",
   "CompatibilityRange" : "1.8-1"
}
*/

$dataManagerIP = "fronius";
	
// $dataManagerIP = "192.168.78.125";
							
$country = "Australia";
$capitalCity ="Perth";

date_default_timezone_set("$country/$capitalCity");

$date = date('Y-m-d', time());
$pushDate = date('Ymd', time());

// Overide Date for Manual Extract
$date = "2023-08-01";

$time = date('H:i', time());

// Overide Time for Manual Extract
// $time = "23:59";

$inverterDataURL = "http://".$dataManagerIP."/solar_api/v1/GetMeterRealtimeData.cgi?Scope=System";
$inverterJSON = file_get_contents($inverterDataURL);

echo $inverterDataURL . "\n";

$arr = json_decode($inverterJSON, true);

$meterSerial = $arr["Body"]["Data"]["0"]["Details"]["Serial"];
$meterModel = $arr["Body"]["Data"]["0"]["Details"]["Model"];

echo "Meter Serial Number: ", $meterSerial, "\n";
echo "Meter Model Number: ", $meterModel, "\n";

// $inverterDataURL = "http://".$dataManagerIP."/solar_api/v1/GetArchiveData.cgi?Scope=System&StartDate=".$date."&EndDate=".$date."&Channel=EnergyReal_WAC_Sum_Produced&Channel=EnergyReal_WAC_Minus_Absolute&Channel=EnergyReal_WAC_Plus_Absolute&Channel=PowerReal_PAC_Sum";

$inverterDataURL = "http://".$dataManagerIP."/solar_api/v1/GetArchiveData.cgi?Scope=System&StartDate=".$date."&EndDate=".$date."&Channel=EnergyReal_WAC_Sum_Produced&Channel=EnergyReal_WAC_Minus_Absolute&Channel=EnergyReal_WAC_Plus_Absolute&Channel=PowerReal_PAC_Sum&Channel=Voltage_DC_String_1&Channel=Current_DC_String_1&Channel=Voltage_DC_String_2&Channel=Current_DC_String_2&Channel=Temperature_Powerstage&Channel=Voltage_AC_Phase_1";
    
$inverterJSON = file_get_contents($inverterDataURL);

echo $inverterDataURL, "\n";

$inverterJSON = file_get_contents($inverterDataURL);
$arr = json_decode($inverterJSON, true);

$x = 0;

$EnergyReal_WAC_Sum_Cumulative = 0;

echo "Time,v1,v2,v3,MPP1,MPP2,MPPT,InvTemp,v6\n";

while ( $x < 86400 && gmdate("H:i", $x) <= $time )
	{
	$EnergyReal_WAC_Sum_Produced = $arr["Body"]["Data"]["inverter/1"]["Data"]["EnergyReal_WAC_Sum_Produced"]["Values"][$x];
	$EnergyReal_WAC_Minus_Absolute = $arr["Body"]["Data"]["meter:IME - " . $meterModel . " - " . $meterSerial]["Data"]["EnergyReal_WAC_Minus_Absolute"]["Values"][$x];
	$EnergyReal_WAC_Plus_Absolute = $arr["Body"]["Data"]["meter:IME - " . $meterModel . " - " . $meterSerial]["Data"]["EnergyReal_WAC_Plus_Absolute"]["Values"][$x];
	$PowerReal_PAC_Sum = $arr["Body"]["Data"]["inverter/1"]["Data"]["PowerReal_PAC_Sum"]["Values"][$x];
	$EnergyReal_WAC_Sum_Cumulative += $EnergyReal_WAC_Sum_Produced;
	
	$Voltage_AC_Phase_1 = $arr["Body"]["Data"]["inverter/1"]["Data"]["Voltage_AC_Phase_1"]["Values"][$x];
	
	$i1 = $arr["Body"]["Data"]["inverter/1"]["Data"]["Current_DC_String_1"]["Values"][$x];
	$i2 = $arr["Body"]["Data"]["inverter/1"]["Data"]["Current_DC_String_2"]["Values"][$x];
    $V1 = $arr["Body"]["Data"]["inverter/1"]["Data"]["Voltage_DC_String_1"]["Values"][$x];
    $V2 = $arr["Body"]["Data"]["inverter/1"]["Data"]["Voltage_DC_String_2"]["Values"][$x];
    $InverterTemperature = $arr["Body"]["Data"]["inverter/1"]["Data"]["Temperature_Powerstage"]["Values"][$x];

    $P1 = $V1 * $i1;
    $P2 = $V2 * $i2;
    $PTOTAL = $P1 + $P2;
	
	if ( $x == 0 ) 
		{
		$startMinus = $EnergyReal_WAC_Minus_Absolute;
		$startPlus =  $EnergyReal_WAC_Plus_Absolute;
		}	
	
	$deltaMinus = $EnergyReal_WAC_Minus_Absolute - $startMinus;
	$deltaPlus = $EnergyReal_WAC_Plus_Absolute - $startPlus;
	
	$consumed = $deltaPlus - $deltaMinus + $EnergyReal_WAC_Sum_Cumulative;
	$time_value = gmdate("H:i", $x);
	echo gmdate("H:i", $x) . "," . $EnergyReal_WAC_Sum_Cumulative . "," . $PowerReal_PAC_Sum . "," . $consumed . "," . $P1 . "," . $P2 . "," . $PTOTAL . "," . $InverterTemperature . "," . $Voltage_AC_Phase_1 . "\n";
	// echo gmdate("H:i", $x) . "," . $EnergyReal_WAC_Sum_Cumulative . "," . $PowerReal_PAC_Sum . "," . $consumed . "," . $deltaMinus . "," . $deltaPlus . "\n";
    $x += 300;
	
	}	
?>

[Decibel]

Thank you for that. This is my clipped output from my Fronius Primo 5K inverter.
I just used my fixed IP and set teh date and time as usual.:

some_ip_value/solar_api/v1/GetMeterRealtimeData.cgi?Scope=System
Meter Serial Number: xxxxxxxx
Meter Model Number: Smart Meter 63A-1
http://some_ip_value/solar_api/v1/GetArchiveData.cgi?Scope=System&StartDate=2023-11-17&EndDate=2023-11-17&Channel=EnergyReal_WAC_Sum_Produced&Channel=EnergyReal_WAC_Minus_Absolute&Channel=EnergyReal_WAC_Plus_Absolute&Channel=PowerReal_PAC_Sum&Channel=Voltage_DC_String_1&Channel=Current_DC_String_1&Channel=Voltage_DC_String_2&Channel=Current_DC_String_2&Channel=Temperature_Powerstage&Channel=Voltage_AC_Phase_1
Time,v1,v2,v3,MPP1,MPP2,MPPT,InvTemp,v6

05:25,0.87416666666667,10.420529801325,2974.8741666667,43.979,22.864,66.843,22,225.5
05:30,5.8625,60.464646464646,3054.8625,61.758,25.09,86.848,24,244.6
05:35,13.366944444444,89.456953642384,3127.3669444444,81.673,32.835,114.508,27,244.9
05:40,22.786388888889,114.17508417508,3195.7863888889,94.122,43.568,137.69,29,245
05:45,34.263055555556,136.80794701987,3269.2630555556,112.064,48.18,160.244,31,244.6

Exactly what I need. Appreciate the quick response.
The header is not working right, but can work out the columns fine.

[grannos]

Hi. Glad it works. I extract and upload the DC power values of both strings and upload them to my PVO account. You can either amend the script so that it does not output the extra column headers and fields or simply not upload them to PVO.

[Decibel]

Yep, I will just disable the additional columns for PVO upload. They make that nice and simple. Thanks again

[bambridge]

Thanks for the script grannos, your work on it is greatly appreciated.
I noticed a few issues for my setup stemming from a different smart meter:
“CCS WattNode WND-3D-480-MB”
My simple fix was to change IME > CCS on lines ~64 + 65 from memory. Worked a treat after that.

[grannos]

Hi thanks for the feedback. I am glad that the script was of use to you.

[darrinm81]

@grannos - Just gave this a go and it worked. Awesome! Much easier than the manual Excel route.

Some feedback:

Could be worth adding an example rather than ‘fronius’ and how you can find this. For me it was via the home network. Probably a simplier way.

$dataManagerIP = “192.168.68.XXX”;

I found it a little confusing to know exactly what to comment out or not on dates and time. Once I got it working I added the two lines below so it is clear on the range.

echo "Date: ", $date, “\n”;
echo "Time: ", $time, “\n”;

[darrinm81]

One last thing.

I am now trying to upload the output to PVO via the Live Loader. I only need Time, Energy Generation (Wh), Power Generation (W), Energy Consumption (Wh) and Power Used (W).

Is this right?

Date Format = CSV
Output Daye = yyyy-mm-dd
Energy Values = Daily Cumulative or daily interval?
Fields:
Time = 1 HH24:mm
Power Generation = 2 W
Power Consumption = 3 W

echo "Time,v1,v2,v3,MPP1,MPP2,MPPT,InvTemp,v6\n";
// EnergyReal_WAC_Sum_Cumulative . "," . $PowerReal_PAC_Sum . "," . $consumed . "," . $P1 . "," . $P2 . "," . $PTOTAL . "," . $InverterTemperature . "," . $Voltage_AC_Phase_1 
// 1 = Time (HH24:mm)
// 2 = EnergyReal_WAC_Sum_Cumulative
// 3 = PowerReal_PAC_Sum
// 4 = consumed
// 5 = P1 
// 6 = P2 
// 7 = PTOTAL 
// 8 = InverterTemperature
// 9 = Voltage_AC_Phase_1

[buthidae]

@grannos Am I right in assuming this script doesn’t work for Gen24 because the GetArchiveData.cgi API doesn’t exist?

[grannos]

You are unfortunately correct. The archive feature doesn’t appear to be available on the GEN24.

[darrinm81]

How can this script be modified to provide non-cumulative values?

[grannos]

Hi @darrinm81. The script could be modified to return interval ENERGY values rather than cumulative values. The GetArchiveData API returns values at 300 second intervals. When I wrote the script I preferred to use cumulative values as it was easier to detect any gross errors ( sanity check ) before posting the data to PVO.
Grannos.