NefMoto

Technical => Data Logging => Topic started by: fluke9 on November 29, 2019, 12:59:20 PM



Title: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on November 29, 2019, 12:59:20 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui




Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: _nameless on November 29, 2019, 01:05:20 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui

Also as soon as i have removed the hackiest hacks i will push to github.



nice work man


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 29, 2019, 01:10:30 PM
nice work man

Thanks! Would be happy if some people could try it on their non ME7.3.1 ecus,
have it working on the bench and in my car and the McMess routines in almost all ME7 bins i disassembled are the same,
so it should work for most of the audi guys here too.


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: nyet on November 30, 2019, 12:29:03 PM
FANTASTIC!

I will definitely give this a shot time permitting.



Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: BlackT on November 30, 2019, 01:40:43 PM
Wow, this is amazing!! Respect man


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 30, 2019, 02:04:02 PM
Thanks a lot guys,
would be happy to get feedback if this works for you.
Updated bin, please redownload again if you already have it, fixed an annoying hang.


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 30, 2019, 04:04:48 PM
just added live ram editing, bin in the link in the first post has been updated ;-)

funny things you can do with this, look:

(https://i.ibb.co/wCfvT6V/after1.png) (https://ibb.co/DkZqNKh)

for most of the stuff its not terrible usable,
because most variables get overwritten fast, but could be used for switching some config etc from the gui.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fknbrkn on November 30, 2019, 04:27:22 PM
Project compiled with debug dll msvcp140d etc
so a lil problem with laptop without VS installed

and somehow gui reacts only on double click when using touchpad


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fknbrkn on November 30, 2019, 04:39:50 PM
Anyway works great on 4B0906032DJ ecu with all 3 options

now wishes list here:)
Refresh button for a list of devices would be nice thing
Conversion formula and converted value option on a preview


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on November 30, 2019, 04:58:55 PM
Project compiled with debug dll msvcp140d etc
so a lil problem with laptop without VS installed
Sorry for that will do release builds in the future ;-)


and somehow gui reacts only on double click when using touchpad
strange, will have to try that on a laptop... might be som ImGui problem,
i opted for it to be portable and small in binary size.

Anyway works great on 4B0906032DJ ecu with all 3 options
fine, first feedback !

now wishes list here:)
Refresh button for a list of devices would be nice thing
Conversion formula and converted value option on a preview
Should autorefresh in the future on dropdown or periodically...

I will actuall do an import of damos and or me7logger cfg so you can see the formula, variable name and stuff in the hexview when you are on it.
I also plan to highlight all known locations then.

Next thing will be a live variables view window,
just all the ones you defined with offset and formula (or imported) and a checkbox.

You just select the ones you want and they will be read as fast as possible,
there will be a filter on top to show only checked ones. Later there should be Log button which logs the checked ones to a file.

Speed increases if live ram view is closed ofcourse, because it reads 1kb/s approx.

So for a 2 byte variable you will be looking at a 500hz update rate ;-)
For 10 of them at 50hz and so on.



UPDATE: uploaded release build ;-)





Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jcsbanks on December 01, 2019, 05:51:29 AM
Well done. Nice not to follow the crowd.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Blazius on December 01, 2019, 07:37:09 AM
Might try this on my na me7.5  & ch340 see if it works when I got time.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on December 01, 2019, 09:16:35 AM
Hey

seems to be a great job sofare, but I have problems with starting the McMessLoggerEvo.exe:
on my PC there XINPUT1_4.dll missing ?!

I found no installation folder or setup, so I just started the McMessLoggerEoo.exe..
Did I anything wrong, or miss ?

Thanks for support.

Jochen

p.s.
I´d like to test McMessLoggerEco on EDC15 :D
EDC15 should support McMess AFAIR, so you logger can be the first ME7Logger simular tool for diesel ECUs  :-*
If it works, nomore slow VCDS-KWP1281 measurement-block lögging !


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 01, 2019, 10:46:59 AM
Hey

seems to be a great job sofare, but I have problems with starting the McMessLoggerEvo.exe:
on my PC there XINPUT1_4.dll missing ?!

I found no installation folder or setup, so I just started the McMessLoggerEoo.exe..
Did I anything wrong, or miss ?

Thanks for support.

Jochen

p.s.
I´d like to test McMessLoggerEco on EDC15 :D
EDC15 should support McMess AFAIR, so you logger can be the first ME7Logger simular tool for diesel ECUs  :-*
If it works, nomore slow VCDS-KWP1281 measurement-block lögging !

Relinked without XInput, the GUI subsystem i use had it enabled for support of different direct x input devices...
Redownload please and report back if it succeeds, should work now on older versions than win10.

Also PLEASE send me your EPK string if you manage to connect.
I might do detection of the ram area based on this, because edc15 might not have ram @38XXXX

Display of the ram should still work as mcmess only works with 2 byte offsets, i show the 38xxxx only out of convienience.






Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 01, 2019, 11:18:09 AM
BTW, does anyone have a description of all damos fields ?

I mean i can make sense of the most of the fields and i guess its enough to get the conversions right,
but sometimes i am baffled about some fields, for example here:

6, /SRC, tmadb, {Bereich Motortemperatur f<81>r Startmengenadaption}, $380BF8, 1, 15, 2, 3;
7, /SRC, tsges_w, {Saugrohrgesamttemperatur (nach AGR-Einleitung) (word)}, $382062, -2, 340, 2, 3;

decoded to:
ID, SRC, NAME, ADDRESS, SIZE, CONVERSION-FROM-REG, ?, ?

Why in hell has the second line a size of -2 bytes (it is 2 bytes for sure)...


Also what are the missing fields in /REG:
162, /REG, nmot_uw_q0p25, {}, 6, 0, {U/min}, 2, 5, 0, 16383.75
/REP, 1, 0, 0, 0.25, 0, 0;

ID, REG, FORMULANAME, COMMENT, ??, ??, UNIT, ??, ??, MIN, MAX
MIN-MAX is the range so applied to a short of size 65535 it gives 0.25 per increment and an offset of 0, works fine, also the REP line shows the increment additionally...







Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: gt-innovation on December 01, 2019, 11:21:31 AM
Relinked without XInput, the GUI subsystem i use had it enabled for support of different direct x input devices...
Redownload please and report back if it succeeds, should work now on older versions than win10.

Also PLEASE send me your EPK string if you manage to connect.
I might do detection of the ram area based on this, because edc15 might not have ram @38XXXX

Display of the ram should still work as mcmess only works with 2 byte offsets, i show the 38xxxx only out of convienience.

Well done for your effort and for sharing that.. Keep up the good work.







Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: QuickS4 on December 01, 2019, 07:10:04 PM
Nice work!

Had a small issue loading.  Crashes when booting on win7.



Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:46:32 AM
Nice work!

Had a small issue loading.  Crashes when booting on win7

Interesting.. Have to try later in a Win7 and XP vm...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on December 02, 2019, 12:12:02 PM
Unless you target Win8.1 SDK it probably won't run on XP/7.1...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:24:29 PM
Unless you target Win8.1 SDK it probably won't run on XP/7.1...

Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:26:18 PM
Currently working on the live variables view and DAMOS parsing,
got it working but need to iron out a few bugs until i can release...

Coming up to a forum near you "very soon"(tm):
(https://i.ibb.co/PDxBGp2/livevariables.png) (https://ibb.co/wcyDhHn)

https://www.youtube.com/watch?v=7tHpwcG10CE


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Blazius on December 02, 2019, 12:31:04 PM
Wow that is sick, doing good job man.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: maciek on December 02, 2019, 01:05:36 PM
Have same issue on Win7, but with Windows 10 it's fine. Thank you!


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on December 02, 2019, 02:33:00 PM
Had a small issue loading.  Crashes when booting on win7.

Same to me, still running WIN7 on logging-PC..

I need to take a lot on updating OS or wait untill McMessLoggerEvo runs on WIN7 too  :)

But again, great work ! and thanks for sharing


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: aef on December 03, 2019, 05:56:24 AM
thx for your time  :D


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 03, 2019, 03:57:52 PM
Small progress update:
Begins to work out really nice...

Next things to tackle:
- Filtering by Function
- Filtering by Editbox
- And ofcourse the "Start Datalogging with selected Variables" button ;-)

(https://i.ibb.co/RBCDHCk/evo.png) (https://ibb.co/7RG1yGd)

https://www.youtube.com/watch?v=BjHFL_pEIw4&feature=youtu.be


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: QuickS4 on December 03, 2019, 09:23:44 PM
Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)

Fluke9, this is pretty awesome, great work!  I've been away and didn't realize you responded.  Thank you for sharing, it's exciting to see how this develops! :)



Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: woj on December 04, 2019, 03:38:58 AM
Looks very cool! If I only had a k-line ME ECU... Which brings me to a question, I think the notes I have found on McMess are by Setzi, he mentions this being the k-line counter part of the CAN calibration protocol. Anyone looked into that one? All ME-s support it? I have pretty much explored everything there is out there in my ME7.9.10 for the OBD2/KWP protocol, including setting up constant flow CAN messages at different frequencies with selected parameters, but I do not believe any of what I have seen is CPP...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 04, 2019, 11:22:32 AM
Looks very cool! If I only had a k-line ME ECU... Which brings me to a question, I think the notes I have found on McMess are by Setzi, he mentions this being the k-line counter part of the CAN calibration protocol. Anyone looked into that one? All ME-s support it? I have pretty much explored everything there is out there in my ME7.9.10 for the OBD2/KWP protocol, including setting up constant flow CAN messages at different frequencies with selected parameters, but I do not believe any of what I have seen is CPP...
I have found McMess in ME9 too,
but so far not in MED17 EDC17 and newer ones...

CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: woj on December 04, 2019, 12:07:50 PM
So what do you know, I am 80% sure plus my well working intuition that my ME7.9.10 has this McMess stuff, I certainly will try your stuff out on my bench where I have the k-line connected. Sadly, the in car ECU does not have k-line at all, so tough luck. But I run only virtualised Windows 7, that will be a problem for now, no? For CCP, since you mentioned key-seed protocol, I looked for xor-s in the code that I have not yet studied, but nothing obvious is visible, so probably not there.

EDIT: Not even a crash, plain no-start, the command prompt window flashes for a split sec and that is it...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 04, 2019, 12:52:24 PM
EDIT: Not even a crash, plain no-start, the command prompt window flashes for a split sec and that is it...

no support below win10 until i find time to relink to an older windows sdk,
sorry but my focus currently is on getting more stuff implemented first.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on December 04, 2019, 03:09:24 PM
CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.
"More". Hardware is involved.
$22 and $23 are your tools on UDS, and they are very fast.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: gt-innovation on December 04, 2019, 03:11:14 PM
I have found McMess in ME9 too,
but so far not in MED17 EDC17 and newer ones...

CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.


I can help on ccp just drop me a message when you need... there is no med17 with mcmess btw... ccp/xcp is what newer ecus are using and you have flash capabilities as well and you can also change things in a certain ram area that ccp/xcp allocates...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: q_dubz on February 24, 2020, 10:25:47 PM
The long read for people like me who have no clue about this stuff:

https://www.mikrocontroller.net/attachment/115911/mcmess_protocol.txt (https://www.mikrocontroller.net/attachment/115911/mcmess_protocol.txt)


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: xero on March 10, 2020, 08:01:59 PM
Someone mentioned that they'd like to see this tested on a diesel ECU - I just happen to have an EDC16U31, of which the matching DAMOS is plastered with McMess information... but no dice. I tried both low and high speed. The log says:

starting connection on <insert your port here> with protocol McMess {LOW|HIGH}SPEED
doing {high|low}speed McMess init...
received response from ECU: 00 00 00 00 00 (5 bytes)
received unknown answer ...
serial port is closed now.

I'd love to contribute to your project!


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on May 19, 2020, 03:17:09 AM
Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)

Are there still investigations to run McMessLoggerEvo on WIN7 Systems ?

Meentime I tryed to run McMessLogger in a Win10 based tablet, but I still connot run, becaus of missing MSVCP140.dll missing :(

BR Jochen


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: FritzP on June 03, 2020, 09:32:46 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui




Very interesting, and very good work.
Will this only work on ME 7 ecu, or can it also work on older motronic ecu with 80515 processor.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: ejg3855 on July 24, 2020, 11:49:16 AM
Nice Work, thank you.

It would be nice to integrate this with a logger so we see where we are in tables. Im envisioning something like how megasquirt tuner works and shows you where you are in the table.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Herleybob on August 10, 2020, 08:11:08 PM
I would love for this to work on a ME17, i can only datalog around 32 bytes at a time and its a lengthy process for me to change the addresses i'm logging.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on August 15, 2020, 07:34:18 AM
Small progress update:
Begins to work out really nice...

Next things to tackle:
- Filtering by Function
- Filtering by Editbox
- And ofcourse the "Start Datalogging with selected Variables" button ;-)

Meanwhile I get McMessLogger running on a Win10-Tab :)

but..
connecting to ME7.5 gets no responce from ECU:

received responce from ECU: 00 00 00 00 00  (5 bytes)
receiced unknown answer ...

connection itself works fine, chancing from McMess-Logger to ME7Logger will show date at the same hardware confing.

What I miss a my version of McMessLogger (form 2.12.2019) is possibility to parse the Damos form connected ECU and all functions to show measurement values.

Maybe I am too blind to find these functions in programm ?

Or is it possible that first linked version is too old for that and only works a Me7.3 ?

If yes, can you please update link, so I can test connection and logging of other McMess supporting ECUs (like ME7.5 or EDC15) ?

Thanks :)


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: timus on August 27, 2020, 10:01:03 AM
Is it possible to use McMessLoggerEvo or McMess protocol in general to log data in EXTRAM past 0x383fff? EXTRAM in me7.5 is 32KB.

Edit:
Never mind, I just look it up inside me7.5 disassembly and its seem like it can read EXTRAM from 0x380000 to 0x387FFF and not only up to 0x383FFF.
Can you fluke9 extend EXTRAM up to this value in your software?


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: totti on October 18, 2020, 04:05:20 PM
Hi,

Where can we download the latest version? And is it possible to change the values in RAM?


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Tomas on April 29, 2021, 03:59:18 AM
Will you be releasing an update?


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on April 29, 2021, 04:06:29 AM
Abandonware, source not released, forget this.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: 360trev on May 30, 2021, 01:50:20 PM
Abandonware, source not released, forget this.

I know the author, he's a good friend and he's given me the full source-code to it, which can be built with Visual Studio on Window's.

I will ping him and ask him if I can put it on Github to help the community...

Trev



Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Blazius on May 30, 2021, 06:53:10 PM
I know the author, he's a good friend and he's given me the full source-code to it, which can be built with Visual Studio on Window's.

I will ping him and ask him if I can put it on Github to help the community...

Trev



Good, but where did fluke go? Havent seen him for some time.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Neuss on December 12, 2021, 12:29:41 PM
I will ping him and ask him if I can put it on Github to help the community...

Any news?


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: speed69 on January 31, 2022, 08:37:49 AM
Any news?

Waiting for news
Looking forward to use a working version of this software


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: StevenW on November 11, 2022, 12:10:13 PM
Something new here?  :o


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: flamy on December 31, 2022, 02:12:20 PM
Works with 8E0909552C (A4 B6 2.4L V6 BDV) .


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: maZer.GTi on January 09, 2023, 04:09:19 PM
Biggest shit for logging.... if someone needs source code of the functions to play just tell me.
But normal OBD connection and readMemory is even faster then this...

Reading always variable wub  with McMess

GETCHARGED ME7-McMess Version 0.1
Connection to the chip opened successfully
Baudrate set to 10400
Format: 10400 8N1 Set
Starting McMess INIT to 10
Baudrate set to 125000
mcMess init success!
mcMess reset Address!
mcMess read Address!
mcMess reading EPK... 1/ME7.5/51/X505R//24C/Dst03o/190504/   
mcMess testing readMemory... success!
04 02
Reading ECU Voltage value for Speedtest...
11.26V A0 EF 63ms
11.26V A0 F0 64ms
11.26V A0 F0 64ms
11.26V A0 F0 64ms
11.26V A0 F0 64ms
11.26V A0 EF 64ms
11.26V A0 F0 63ms
11.26V A0 EF 64ms
11.26V A0 F0 64ms


Same with normal diagnostic session and readMemoryByAddress
Sleeping for 2000 ms and trying ID 0x11
Trying to Wake up ECU on ID: 11
Baudrate set to 10400
Starting SlowInit to 11
KWP Protocol Version: 2031
Controller give us Communication ID: "11"
Format: 10400 8N1 Set
Starting Communication...
Testing DDLI is enabled for us
DDLI Enabled
Starting 86 Session...
Baudrate set to 56000
Reading ECU Voltage value for Speedtest...
11.26V A0 EF 47ms
11.26V A0 F0 48ms
11.26V A0 EF 47ms
11.26V A0 F0 48ms
11.26V A0 F0 42ms
11.26V A0 F0 54ms
11.26V A0 F0 48ms
11.26V A0 F0 48ms
11.26V A0 F0 44ms
11.26V A0 F0 52ms
11.26V A0 F0 48ms
11.26V A0 F0 46ms
11.26V A0 F0 49ms
11.26V A0 F0 48ms


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on January 09, 2023, 07:08:48 PM
Pretty sure what the guy did there was use the crank-sync logging and he patched the routine to have more than 6 addresses.
But... it's just possible to abuse the DDLI arrays on the fly like ME7Logger does without having to patch anything in the file.

So I don't see any point in this.