NefMoto

Technical => Data Logging => Topic started by: fluke9 on November 29, 2019, 12:59:20 PM



Title: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on November 29, 2019, 12:59:20 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui




Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: Marty on November 29, 2019, 01:05:20 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui

Also as soon as i have removed the hackiest hacks i will push to github.



nice work man


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 29, 2019, 01:10:30 PM
nice work man

Thanks! Would be happy if some people could try it on their non ME7.3.1 ecus,
have it working on the bench and in my car and the McMess routines in almost all ME7 bins i disassembled are the same,
so it should work for most of the audi guys here too.


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: nyet on November 30, 2019, 12:29:03 PM
FANTASTIC!

I will definitely give this a shot time permitting.



Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: BlackT on November 30, 2019, 01:40:43 PM
Wow, this is amazing!! Respect man


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 30, 2019, 02:04:02 PM
Thanks a lot guys,
would be happy to get feedback if this works for you.
Updated bin, please redownload again if you already have it, fixed an annoying hang.


Title: Re: McMessLoggerEvo - realtime ram display and more to come...
Post by: fluke9 on November 30, 2019, 04:04:48 PM
just added live ram editing, bin in the link in the first post has been updated ;-)

funny things you can do with this, look:

(https://i.ibb.co/wCfvT6V/after1.png) (https://ibb.co/DkZqNKh)

for most of the stuff its not terrible usable,
because most variables get overwritten fast, but could be used for switching some config etc from the gui.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fukenbroken on November 30, 2019, 04:27:22 PM
Project compiled with debug dll msvcp140d etc
so a lil problem with laptop without VS installed

and somehow gui reacts only on double click when using touchpad


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fukenbroken on November 30, 2019, 04:39:50 PM
Anyway works great on 4B0906032DJ ecu with all 3 options

now wishes list here:)
Refresh button for a list of devices would be nice thing
Conversion formula and converted value option on a preview


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on November 30, 2019, 04:58:55 PM
Project compiled with debug dll msvcp140d etc
so a lil problem with laptop without VS installed
Sorry for that will do release builds in the future ;-)


and somehow gui reacts only on double click when using touchpad
strange, will have to try that on a laptop... might be som ImGui problem,
i opted for it to be portable and small in binary size.

Anyway works great on 4B0906032DJ ecu with all 3 options
fine, first feedback !

now wishes list here:)
Refresh button for a list of devices would be nice thing
Conversion formula and converted value option on a preview
Should autorefresh in the future on dropdown or periodically...

I will actuall do an import of damos and or me7logger cfg so you can see the formula, variable name and stuff in the hexview when you are on it.
I also plan to highlight all known locations then.

Next thing will be a live variables view window,
just all the ones you defined with offset and formula (or imported) and a checkbox.

You just select the ones you want and they will be read as fast as possible,
there will be a filter on top to show only checked ones. Later there should be Log button which logs the checked ones to a file.

Speed increases if live ram view is closed ofcourse, because it reads 1kb/s approx.

So for a 2 byte variable you will be looking at a 500hz update rate ;-)
For 10 of them at 50hz and so on.



UPDATE: uploaded release build ;-)





Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jcsbanks on December 01, 2019, 05:51:29 AM
Well done. Nice not to follow the crowd.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Blazius on December 01, 2019, 07:37:09 AM
Might try this on my na me7.5  & ch340 see if it works when I got time.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on December 01, 2019, 09:16:35 AM
Hey

seems to be a great job sofare, but I have problems with starting the McMessLoggerEvo.exe:
on my PC there XINPUT1_4.dll missing ?!

I found no installation folder or setup, so I just started the McMessLoggerEoo.exe..
Did I anything wrong, or miss ?

Thanks for support.

Jochen

p.s.
I´d like to test McMessLoggerEco on EDC15 :D
EDC15 should support McMess AFAIR, so you logger can be the first ME7Logger simular tool for diesel ECUs  :-*
If it works, nomore slow VCDS-KWP1281 measurement-block lögging !


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 01, 2019, 10:46:59 AM
Hey

seems to be a great job sofare, but I have problems with starting the McMessLoggerEvo.exe:
on my PC there XINPUT1_4.dll missing ?!

I found no installation folder or setup, so I just started the McMessLoggerEoo.exe..
Did I anything wrong, or miss ?

Thanks for support.

Jochen

p.s.
I´d like to test McMessLoggerEco on EDC15 :D
EDC15 should support McMess AFAIR, so you logger can be the first ME7Logger simular tool for diesel ECUs  :-*
If it works, nomore slow VCDS-KWP1281 measurement-block lögging !

Relinked without XInput, the GUI subsystem i use had it enabled for support of different direct x input devices...
Redownload please and report back if it succeeds, should work now on older versions than win10.

Also PLEASE send me your EPK string if you manage to connect.
I might do detection of the ram area based on this, because edc15 might not have ram @38XXXX

Display of the ram should still work as mcmess only works with 2 byte offsets, i show the 38xxxx only out of convienience.






Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 01, 2019, 11:18:09 AM
BTW, does anyone have a description of all damos fields ?

I mean i can make sense of the most of the fields and i guess its enough to get the conversions right,
but sometimes i am baffled about some fields, for example here:

6, /SRC, tmadb, {Bereich Motortemperatur f<81>r Startmengenadaption}, $380BF8, 1, 15, 2, 3;
7, /SRC, tsges_w, {Saugrohrgesamttemperatur (nach AGR-Einleitung) (word)}, $382062, -2, 340, 2, 3;

decoded to:
ID, SRC, NAME, ADDRESS, SIZE, CONVERSION-FROM-REG, ?, ?

Why in hell has the second line a size of -2 bytes (it is 2 bytes for sure)...


Also what are the missing fields in /REG:
162, /REG, nmot_uw_q0p25, {}, 6, 0, {U/min}, 2, 5, 0, 16383.75
/REP, 1, 0, 0, 0.25, 0, 0;

ID, REG, FORMULANAME, COMMENT, ??, ??, UNIT, ??, ??, MIN, MAX
MIN-MAX is the range so applied to a short of size 65535 it gives 0.25 per increment and an offset of 0, works fine, also the REP line shows the increment additionally...







Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: gt-innovation on December 01, 2019, 11:21:31 AM
Relinked without XInput, the GUI subsystem i use had it enabled for support of different direct x input devices...
Redownload please and report back if it succeeds, should work now on older versions than win10.

Also PLEASE send me your EPK string if you manage to connect.
I might do detection of the ram area based on this, because edc15 might not have ram @38XXXX

Display of the ram should still work as mcmess only works with 2 byte offsets, i show the 38xxxx only out of convienience.

Well done for your effort and for sharing that.. Keep up the good work.







Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: QuickS4 on December 01, 2019, 07:10:04 PM
Nice work!

Had a small issue loading.  Crashes when booting on win7.



Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:46:32 AM
Nice work!

Had a small issue loading.  Crashes when booting on win7

Interesting.. Have to try later in a Win7 and XP vm...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on December 02, 2019, 12:12:02 PM
Unless you target Win8.1 SDK it probably won't run on XP/7.1...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:24:29 PM
Unless you target Win8.1 SDK it probably won't run on XP/7.1...

Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 02, 2019, 12:26:18 PM
Currently working on the live variables view and DAMOS parsing,
got it working but need to iron out a few bugs until i can release...

Coming up to a forum near you "very soon"(tm):
(https://i.ibb.co/PDxBGp2/livevariables.png) (https://ibb.co/wcyDhHn)

https://www.youtube.com/watch?v=7tHpwcG10CE


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: Blazius on December 02, 2019, 12:31:04 PM
Wow that is sick, doing good job man.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: maciek on December 02, 2019, 01:05:36 PM
Have same issue on Win7, but with Windows 10 it's fine. Thank you!


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on December 02, 2019, 02:33:00 PM
Had a small issue loading.  Crashes when booting on win7.

Same to me, still running WIN7 on logging-PC..

I need to take a lot on updating OS or wait untill McMessLoggerEvo runs on WIN7 too  :)

But again, great work ! and thanks for sharing


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: aef on December 03, 2019, 05:56:24 AM
thx for your time  :D


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 03, 2019, 03:57:52 PM
Small progress update:
Begins to work out really nice...

Next things to tackle:
- Filtering by Function
- Filtering by Editbox
- And ofcourse the "Start Datalogging with selected Variables" button ;-)

(https://i.ibb.co/RBCDHCk/evo.png) (https://ibb.co/7RG1yGd)

https://www.youtube.com/watch?v=BjHFL_pEIw4&feature=youtu.be


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: QuickS4 on December 03, 2019, 09:23:44 PM
Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)

Fluke9, this is pretty awesome, great work!  I've been away and didn't realize you responded.  Thank you for sharing, it's exciting to see how this develops! :)



Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: woj on December 04, 2019, 03:38:58 AM
Looks very cool! If I only had a k-line ME ECU... Which brings me to a question, I think the notes I have found on McMess are by Setzi, he mentions this being the k-line counter part of the CAN calibration protocol. Anyone looked into that one? All ME-s support it? I have pretty much explored everything there is out there in my ME7.9.10 for the OBD2/KWP protocol, including setting up constant flow CAN messages at different frequencies with selected parameters, but I do not believe any of what I have seen is CPP...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 04, 2019, 11:22:32 AM
Looks very cool! If I only had a k-line ME ECU... Which brings me to a question, I think the notes I have found on McMess are by Setzi, he mentions this being the k-line counter part of the CAN calibration protocol. Anyone looked into that one? All ME-s support it? I have pretty much explored everything there is out there in my ME7.9.10 for the OBD2/KWP protocol, including setting up constant flow CAN messages at different frequencies with selected parameters, but I do not believe any of what I have seen is CPP...
I have found McMess in ME9 too,
but so far not in MED17 EDC17 and newer ones...

CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: woj on December 04, 2019, 12:07:50 PM
So what do you know, I am 80% sure plus my well working intuition that my ME7.9.10 has this McMess stuff, I certainly will try your stuff out on my bench where I have the k-line connected. Sadly, the in car ECU does not have k-line at all, so tough luck. But I run only virtualised Windows 7, that will be a problem for now, no? For CCP, since you mentioned key-seed protocol, I looked for xor-s in the code that I have not yet studied, but nothing obvious is visible, so probably not there.

EDIT: Not even a crash, plain no-start, the command prompt window flashes for a split sec and that is it...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: fluke9 on December 04, 2019, 12:52:24 PM
EDIT: Not even a crash, plain no-start, the command prompt window flashes for a split sec and that is it...

no support below win10 until i find time to relink to an older windows sdk,
sorry but my focus currently is on getting more stuff implemented first.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: prj on December 04, 2019, 03:09:24 PM
CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.
"More". Hardware is involved.
$22 and $23 are your tools on UDS, and they are very fast.


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: gt-innovation on December 04, 2019, 03:11:14 PM
I have found McMess in ME9 too,
but so far not in MED17 EDC17 and newer ones...

CCP should be supported by all ecus after (maybe including ME9) but i did not look into the details yet.
Expect bumped up security and atleast a seed-key implementation or even more.


I can help on ccp just drop me a message when you need... there is no med17 with mcmess btw... ccp/xcp is what newer ecus are using and you have flash capabilities as well and you can also change things in a certain ram area that ccp/xcp allocates...


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: q_dubz on February 24, 2020, 10:25:47 PM
The long read for people like me who have no clue about this stuff:

https://www.mikrocontroller.net/attachment/115911/mcmess_protocol.txt (https://www.mikrocontroller.net/attachment/115911/mcmess_protocol.txt)


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: xero on March 10, 2020, 08:01:59 PM
Someone mentioned that they'd like to see this tested on a diesel ECU - I just happen to have an EDC16U31, of which the matching DAMOS is plastered with McMess information... but no dice. I tried both low and high speed. The log says:

starting connection on <insert your port here> with protocol McMess {LOW|HIGH}SPEED
doing {high|low}speed McMess init...
received response from ECU: 00 00 00 00 00 (5 bytes)
received unknown answer ...
serial port is closed now.

I'd love to contribute to your project!


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: jochen_145 on May 19, 2020, 03:17:09 AM
Can do all that later, my code is portable enough, currently its a all still a rough WIP,
but i am so pleased with how it turns out that i wanted to share ;-)

Are there still investigations to run McMessLoggerEvo on WIN7 Systems ?

Meentime I tryed to run McMessLogger in a Win10 based tablet, but I still connot run, becaus of missing MSVCP140.dll missing :(

BR Jochen


Title: Re: McMessLoggerEvo - realtime ram display and editor, more to come
Post by: FritzP on June 03, 2020, 09:32:46 PM
I am glad i did not listen as everbody told me McMess is just a braindead protocol of no use...
Actually its fucking useful and with 1kb/s read capabilities not the slowest one ;-)

So please take a quick look at this:
https://www.youtube.com/watch?v=QTydB5fx6wo&feature=youtu.be

and that:
(https://i.ibb.co/5MCNTng/xxx.png) (https://ibb.co/6nG3Y17)

Please try it yourself here and tell me if it works for you:
https://drive.google.com/open?id=19PmsdsiBaBKSwHI0UzimwuDXrD6xViUg

A lot more is to come:
a.) some nifty tools like the live ram view you have seen
b.) a logger which takes damos files for definitions and maybe other formats (ME7Logger?)
c.) a dashboard gui




Very interesting, and very good work.
Will this only work on ME 7 ecu, or can it also work on older motronic ecu with 80515 processor.