FreeRTOS Windows Simulator Build Changes and LTS 2.0 Update (#872)

* Update mbedtls to version v3.2.1

* Adjust include paths for github workflow

* Update FreeRTOS+TCP to v3.1.0

* Add initial VS project files for Kernel, +TCP, and mbedtls

* winpcap: Consolidate to a single copy of WinPcap

* Downgrade library projects to VS 2019. Add heap_4 to kernel.

* Remove *.vcxproj.user files and add to gitignore

* Disable unwanted kernel config options

* Update FreeRTOS+TCP and Kernel include paths

* Update FreeRTOS+TCP Windows Minimal sln

* Remove .suo and .vcxproj.user files

* Update mbedtls transport implementations for mbedtls v3.2.1

* Fix typo in mbedtls_freertos_port.c

* Update vcxproj files for +TCP, Kernel, Mbedtls

* Fix typo in name WindowSimulator -> WindowsSimulator

* Add wpcap lib to FreeRTOS+TCP.vcxproj

* Update FreeRTOS+TCP Minimal Demo for Windows Simulator

* Mask MSVC string function warnings

Aad _CRT_SECURE_NO_WARNINGS preprocessor definition.

* Move projects to their own directories to make VisualStudio happy

* mbedtls_freertos_port.c: Fix formatting?

* Add coreHTTP, Logging libs. Adjust dependencies

* Disable FreeRTOS Kernel malloc failed hook

* Update coreHTTP Plaintext demo

* Rename / relocate transport interface implementations

* Remove old VS project files

* Remove extra core_http_config.h files

* Remove extra FreeRTOSConfig.h files

* Remove extra FreeRTOSIPConfig.h files

* Remove old mbedtls_config.h files

* Remove old FreeRTOSConfig and core_http_config files

* Update HTTP Mutual Auth Demo build files

* Fix transport_plaintext.h include name

* Update HTTP_Plaintext demo build files

* Update CoreHTTP_S3_Download VS project files

* Update HTTP_S3_Upload demo build files

* Update CoreHTTP_S3_Download_Multithreaded demo build files

* Add GithubActions builds for FreeRTOS+ CoreHTTP Demos

* Update S3DownloadHTTPExample.c to be compatible with mbedtls 3.x

* Update GithubActions FreeRTOS+ config file

* Combine core_pkcs11_config.h files into a single one

* Add corePKCS11 VS project file

* Update corePKCS11 WinSim demo project and build files

* Update corePKCS11 library to version 3.5.0

* Modifiying demos to build using static libraries

* Adding a header file

* Two more demos

* Update corePKCS11 demo code and auto-format

* Downgrade corePKCS11 library build file to v142 / VS 2019

* Speed up CI builds with selective submodule initialization

* Separate corePKCS11 demo into it's own job.

* Remove WIN32.vcxproj and WIN32.vcxproj.filters files

* Remove old configuration header files

Partially reverts 73829ced6061e4584e521185178a61b4a437c5e0

* Revert unwanted coreHTTP demo changes

* Changing include paths for demos

* Adding an include

* MQTT WoflSSL Demo update

* wolfSSL Demo changes

* Config changes for MQTT Demos

* Initial Device Defender demo update.

* Initial Device Shadow demo update.

* Update mbedtls_transport_pkcs11 for Mbedtls 3.x

* Update corePKCS11 MQTT Mutual Auth demo

* Add a default definition of SdkLog

* Update CorePKCS11 + MQTT Mutual Auth demo sln name

* Build all configs of coreHTTP demos

* Update coreSNTP Demo build files.

* Update coreSNTP Demo sln name

* Update FreeRTOS+TCP Posix demo

* Update FreeRTOS+TCP Qemu ARM MPS2 AN385 Demo

* Update FreeRTOS+TCP Demo Github Actions builds

* Update Fleet Provisioning WinSim Demo build files

* Remove mbedtls_pk_info_t references from mbedtls_pk_pkcs11.h

* Restore / update the FreeRTOS+TCP Minimal WinSim demo

* Initial Jobs demo update.

* Fix jobs demo build.

* Initial OTA over HTTP demo update.

* Initial OTA over MQTT demo update.

* Ota_Over_Mqtt_Demo build fix.

* OTA over MQTT demo fix.

* Update HTTP demo solution file name for CI.

* Update Github actions workflow to old HTTP demo names.

* Update coreSTNP demo to old solution name.

* Fix defender demo / fix mbedtls config to use threading alt.

* Add MBEDTLS_CONFIG_FILE definition to each config

* Fix config file name.

* MQTT Mutual auth fixes.

* Fix job demo.

* Device shadow demo fixes.

* Fix coreSNTP demo not setting alt threading functions for mbedtls.

* Enable Static allocation, Add default hooks for FreeRTOS Kernel and +TCP

* Add xPlatformIsNetworkUp platform function to FreeRTOS+TCP hooks

* Enable runtime statistics in the Windows Simualator Kernel config

* Revert "Fix coreSNTP demo not setting alt threading functions for mbedtls."

This reverts commit 9069707519561ca8136d58c0f18fb176c9050a1d.

* Revert mbedtls threading related config changes

* Add xPlatformIsNetworkUp function prototype

* Remove boileplate FreeRTOS kernel and +tcp hooks

* Refactor device defender demo for clarity

* Add wait loop calling xPlatformIsNetworkUp

* Add missing vPlatformInitLogging function

* Add vPlatformInitLogging and vLoggingPrintf defitions to logging headers

* Updating the FreeRTOS_Plus_CLI_with_Trace_Windows_Simulator

* Updating the FreeRTOS_Plus_Reliance_Edge_and_CLI_Windows_Simulator demo

* Updates to the FreeRTOS_Plus_WolfSSL_Windows_Simulator demo

* Fixing wrong include path

* Upating FreeRTOS_Plus_WolfSSL_FIPS_Ready_Windows_Simulator demo

* Update coreMQTT WinSim demos to print start and end condition.

* Modifiying repos updated as part of the CLI demo GitHub workflow

* Removing duplicate functions from the FreeRTOS_Plus_TCP_Minimal_Windows_Simulator demo

* Updated FreeRTOS_Plus_TCP_UDP_Mode_CLI_Windows_Simulator demo

* Updating corePKCS11_MQTT_Mutual_Auth_Windows_Simulator Demo to call the static function that creates task

* Fix log message using unitialized string in MQTT Multitask demo.

* Fixing a broken extern function

* Fixing a typo extern function name

* Added a reference to coreHTTP

* Fixing a pre-processor issue in the OTA_Over_Http_Demo

* Updating the MQTT_Mutual_Auth_Demo_with_BG96 demo

* Updating the MQTT_Mutual_Auth_Demo_with_HL7802 demo

* Changes to the MQTT_Mutual_Auth_Demo_with_SARA_R4 demo

* Fix demos for CI.

* Adding the source path to the CBMC proofs for FreeRTOS+TCP

* Spell check fixes, adding words to lexicons

* Fixing a typo

* Add arg to skip prompt in setup script.

* Update paths of script to be relative to the file.

* Changing manifest.yml file to point to corePKCS11 3.5.0

* Added CI markers to cellular demos.

* Fix cellular demo flow.

* Fix celullar demos.

* Initial TCP sockets wrapper rework - will break things.

* First cellular demo fix for new sockets wrapper.

* Minor fix to cellular sockets wrapper.

* Fix mbedtls bio using FreeRTOS Plus TCP call.

* Clean up BG96 demo project files.

* Update HL7802 demo.

* Fix SARA R4 demo for new sockets wrapper.

* Fix Device Defender, Device Shadow, and Fleet PRovisioning.

* Fix Jobs demo.

* Fix OTA over HTTP demo.

* Fix OTA over MQTT demo.

* Fix HTTP mutual auth demo.

* Fix OTA over MQTT demo endianness.

* Fix OTA over HTTP demo endianness.

* Fix HTTP Plaintext demo.

* Fix HTTP S3 download demo.

* Fix plaintext transport

* Fix OTA demos.

* Fix OTA demos.

* Fix OTA HTTP demo.

* Fix HTTP S3 Download multithreaded demo.

* Fix HTTP S3 Upload demo

* Fix corePKCS11 Mutual Auth demo.

* Updating MQTT_Mutual_Auth

* Update pkcs11 setup script.

* Updating the MQTT_Basic_TLS Demo

* Organize PKCS11 demos project.

* Updating MQTT_Keep_Alive demo

* Clean up SNTP demo.

* Updated MQTT_Multitask demo

* Updated MQTT_Plain_Text

* Updating the MQTT_Serializer Demo

* Updating corePKCS11_MQTT_Mutual_Auth_Windows_Simulator

* Updating coreSNTP_Windows_Simulator

* Clean up demo projects.

* Add markers to PKCS11 mutual auth demo.

* Fix Fleet Provisioning demo script.

* Fix SNTP demo solution.

* Fix coreSNTP project files.

* Fix Fleet Provisiong script.

* Fix fleet provisioning script.

* Fix demo config template.

* Fleet provisioning demo markers.

* Updating MQTT_Mutual_Auth_wolfSSL demo and the transport_wolfSSL file

* Fixing FreeRTOS_Plus_TCP_Echo_POSIX

* Fixing CLI and Trace Demos

* Fixing TCP_ECHO_POSIX demo

* Adding a word to the lexicon

* Remove unneeded files.

* Update github workflows to use Ubuntu 20.04.

* Change OTA demo target names to RTOSDemo for OTAE2E tests.

* Fixing Headers

* Updating headers

* Two more headers

* Adding words to the lexicon

* Whitepsace

* Ignore mbedtls config file for header check.

* Removing FreeRTOS Header from the mbedtls_config_v3.2.1.h file

* Fix bug in lPKCS11PkMbedtlsCloseSessionAndFree. Add doxygen api docs.

* Update lexicon.txt

* Fix spelling

* Apply suggestions from code review

Co-authored-by: jasonpcarroll <23126711+jasonpcarroll@users.noreply.github.com>

* Add return code comment for p11_ecdsa_ctx_init

* Rename WindowsSimulator folder to VisualStudio_StaticProjects.

* Remove references to coroutines

* Fix mbedtls_pk_pkcs11.c

* Update to LTS 2.0 submodule pointers (#880)

* Update submodule pointers to LTS 2.0

* Initial coreMQTT 2.1.1 update.

* Update AWS demos for coreMQTT 2.1.1

* Fix deprecated macro for coreMQTT demos.

* Fix keep alive demo.

* Fix plaintext demo.

* Fix MQTT wolfSSL demo.

* Fix MQTT PKCS11 demo.

* Remove duplicate functions.

* Fix Mutual auth demos for Cellular.

* Fix OTA demos.

* Fix header of plaintext demo config.

* Set writev to NULL for OTA demos.

* Fix mbedlts config for OTA demos.

* Fix spelling.

Co-authored-by: Jason Carroll <czjaso@amazon.com>

* Removing blank line

* Fix jobs demo race condition.

* Fix race condition from WinPCap network interface.

* Update lexicon.

Co-authored-by: Paul Bartell <pbartell@amazon.com>
Co-authored-by: Jason Carroll <czjaso@amazon.com>
Co-authored-by: Paul Bartell <paul.bartell@gmail.com>
Co-authored-by: jasonpcarroll <23126711+jasonpcarroll@users.noreply.github.com>

lexicon.txt

@@ -18,13 +18,16 @@ addvectoredexceptionhandler
 adel
 ades
 adp
+aead
 aes
+aesni
 afer
 afio
 ahb
 aic
 aiec
 ajax
+aka
 alpn
 alt
 altera
@@ -75,6 +78,7 @@ aws
 backlight
 backoff
 backoffalgorithm
+backtrace
 balternatesetting
 baltimore
 barry
@@ -157,6 +161,7 @@ brdiv
 brdl
 brgh
 brs
+bsd
 bsl
 bslaveinterface
 bsp
@@ -183,7 +188,9 @@ cac
 cachable
 calender
 calloc
+cas
 cb
+cbc
 cbconfigurationvalue
 cbdescriptortype
 cbio
@@ -204,6 +211,7 @@ cd
 cdatastring
 cdc
 cec
+cellularconnect
 cellularconnectionloop
 cellulardemo
 cellulardemotask
@@ -225,7 +233,9 @@ ceu
 cexception
 cexpectednumberofparameters
 cexpectedstring
+cfb
 cfginitialize
+cflags
 cg
 cgreg
 ch
@@ -238,9 +248,13 @@ checktimer
 checkval
 checkvalue
 checon
+chinese
 chunked
 ci
 ciconfiguration
+cid
+ciphersuite
+ciphertext
 circleos
 ck
 cka
@@ -271,6 +285,7 @@ clocksource
 closesession
 cloudformation
 cmac
+cmake
 cmaxpower
 cmcnt
 cmd
@@ -437,6 +452,8 @@ crend
 crflash
 crfmax
 crgflg
+crl
+crls
 crossstudio
 crredentials
 crstart
@@ -445,6 +462,7 @@ crxlock
 crxstring
 crypotki
 crypto
+cryptoapi
 cryptointerface
 cryptoki
 csamplepagefirstpart
@@ -453,6 +471,7 @@ cserialputchar
 cserverhost
 csr
 csrc
+csrs
 css
 cstring
 ctaskwokenbypost
@@ -526,6 +545,7 @@ demoiptrace
 demosetup
 demotask
 demotimer
+demultiplexing
 der
 des
 desc
@@ -544,9 +564,11 @@ dfreertos
 dgram
 dgst
 dhcp
+dhe
 dhm
 didn
 diff
+diffie
 digicert
 digitcounter
 dimentions
@@ -603,13 +625,19 @@ eblocked
 ebset
 ebwait
 ec
+ecc
+ecdh
+ecdhe
 ecdsa
 echobuffer
 echomultitx
+ecjpake
 ecmd
 ecp
+ecparameters
 ecparams
 ecparamsptr
+ecpoint
 edbg
 edk
 edrx
@@ -786,6 +814,7 @@ fp
 fpe
 fpga
 fpidiv
+fprintf
 fpu
 fr
 framming
@@ -804,6 +833,7 @@ freq
 freqency
 fromisr
 fs
+fsanitize
 fseek
 fsl
 fsram
@@ -823,6 +853,7 @@ fx
 fxp
 fxx
 galileo
+galois
 gc
 gcc
 gcm
@@ -846,6 +877,7 @@ getstate
 getsubackstatuscodes
 gettopic
 gettopicstring
+gf
 gic
 gio
 giosetbit
@@ -853,7 +885,9 @@ gir
 girq
 girqm
 github
+glibc
 gmon
+gmtime
 gnd
 gnuc
 googleapis
@@ -868,6 +902,7 @@ gpios
 greacefully
 grec
 gree
+grp
 gsm
 hal
 halboardinit
@@ -878,6 +913,8 @@ hcomm
 hcs
 hed
 hein
+hellman
+helloverifyrequest
 het
 hetbase
 hetport
@@ -925,6 +962,7 @@ hw
 hwmax
 hyperterminal
 hz
+ia
 iar
 iasmarm
 ibe
@@ -1100,6 +1138,7 @@ khz
 kib
 kickstart
 knowns
+kw
 kx
 lapic
 lastsynctickcount
@@ -1283,13 +1322,16 @@ mec
 mechanims
 mechansim
 mem
+memcheck
 memcmp
 memcpy
 memfault
 memmanage
 memoryleak
+memorysanitizer
 mems
 memset
+merkle
 messagebufferlocations
 messagetype
 metadata
@@ -1302,6 +1344,7 @@ microcontrollers
 microsemi
 microsoft
 microzed
+middlebox
 mii
 mikroc
 miliseconds
@@ -1319,12 +1362,14 @@ mkdir
 mmcr
 mno
 mnos
+montgomery
 mosquitto
 mov
 movs
 mp
 mpc
 mpi
+mpis
 mps
 mpsoc
 mpu
@@ -1389,6 +1434,7 @@ netstat
 networkcontext
 networkcredentials
 nextjobexecutionchanged
+ni
 nic
 nirq
 nist
@@ -1412,6 +1458,7 @@ ns
 nsc
 nscfunction
 nsec
+nspe
 nt
 ntp
 ntpdemo
@@ -1422,14 +1469,18 @@ num
 numaker
 numberofitems
 numofservers
+nv
 nvic
 nvs
 nxp
+oaep
 ocd
 oe
 oer
 oerr
+ofb
 oid
+oids
 ok
 oled
 olen
@@ -1488,6 +1539,7 @@ ovfl
 pacdata
 packetid
 pactopic
+pake
 palpnprotos
 param
 paramater
@@ -1506,7 +1558,9 @@ payloadlength
 pb
 pbasetime
 pbclk
+pbe
 pbuf
+pbuff
 pbuffer
 pbufs
 pc
@@ -1669,6 +1723,8 @@ pj
 pk
 pkcs
 pki
+pkparse
+pkwrite
 plaformimagestate
 plaintext
 plaintexthttpexample
@@ -1681,11 +1737,13 @@ pllclk
 pllclock
 pllon
 plls
+plrng
 pm
 pmc
 pml
 pmp
 pmqttagentcontext
+pmqttcontext
 pmsg
 pmsgctx
 pmu
@@ -1944,6 +2002,7 @@ prvstatcommand
 prvstatfscommand
 prvstaticallyallocatedcreator
 prvstaticallyallocatedtask
+prvstreambufferadd
 prvsubscribetodefendertopics
 prvsynctask
 prvtaskstatscommand
@@ -1970,8 +2029,11 @@ prvunlockqueue
 prvupdateacceptedhandler
 prvupdatedeltahandler
 prvwin
+prvwinpcaprecvthread
+prvwinpcapsendthread
 prvzerocopyechoclienttask
 ps
+psa
 psc
 pscheckvariable
 psel
@@ -1979,6 +2041,7 @@ pserver
 pserverinfo
 pservertime
 psignature
+psk
 psl
 pslotlist
 psm
@@ -1989,6 +2052,7 @@ psoc
 psocket
 psr
 psregistrationstatus
+pss
 psslcontext
 pstartheaderloc
 pstplatformimagestate
@@ -1999,6 +2063,7 @@ ptal
 ptcpsocket
 pth
 pthingname
+pthread
 ptime
 ptimeserver
 ptimeservers
@@ -2025,6 +2090,7 @@ pucethernetbufferpointeres
 pucethernetbufferpointers
 puchash
 pucindex
+pucinterfacename
 pucmessage
 pucpayloadbuffer
 pucqueuestorage
@@ -2066,6 +2132,7 @@ putc
 putchar
 puxstackbuffer
 pv
+pvalue
 pvargs
 pvbuffer
 pvcontext
@@ -2086,6 +2153,7 @@ pwm
 pwpr
 pwr
 pxaddresslen
+pxattrs
 pxbuffer
 pxcallback
 pxcertificatebufferlength
@@ -2109,6 +2177,7 @@ pxecparamsptr
 pxexpiredtimer
 pxfilesize
 pxftpclient
+pxfunctionlist
 pxheadersdatalen
 pxhigherprioritytaskwoken
 pxincomingpacket
@@ -2118,6 +2187,7 @@ pxisrfunction
 pxknownmessage
 pxlist
 pxmbedpkcontext
+pxmbedtlspkctx
 pxmetrics
 pxmqttcontext
 pxnetif
@@ -2200,6 +2270,7 @@ queuesuspend
 ra
 rampz
 rand
+random
 randomisation
 randomise
 randomised
@@ -2258,6 +2329,7 @@ reportid
 reqds
 reqenc
 reqens
+reseed
 resending
 resetart
 resetprg
@@ -2265,6 +2337,7 @@ resoltion
 resp
 responsebuffer
 responsesize
+restartable
 resubscribe
 resubscribes
 resync
@@ -2299,6 +2372,8 @@ rootdelay
 rootdispersion
 rowley
 rsa
+rsaes
+rsassa
 rsk
 rskrl
 rskrx
@@ -2318,6 +2393,7 @@ rtccprsch
 rti
 rtos
 rtosdemo
+rtp
 rts
 rv
 rw
@@ -2365,6 +2441,7 @@ sdk
 sdklog
 sec
 secretaccesskey
+seedfile
 seg
 segfault
 sel
@@ -2397,6 +2474,7 @@ serverhost
 serverport
 sessiontoken
 setbaudratevalue
+setbuf
 setfaketaskpriority
 setimagestate
 setpollisr
@@ -2465,14 +2543,19 @@ softbaugh
 somewebsite
 sp
 spbrg
+spdx
+spe
+specifiedecdomain
 spen
 spi
+spm
 sprintf
 spu
 sr
 sram
 src
 sren
+srtp
 ss
 sscanf
 ssi
@@ -2502,6 +2585,7 @@ statictask
 statictimer
 statusmessage
 stdarg
+stderr
 stdint
 stdlib
 stdout
@@ -2648,6 +2732,7 @@ topiclen
 topiclength
 tp
 tracelisttasks
+traceonenter
 tracetask
 trafic
 transmaskget
@@ -2671,6 +2756,7 @@ trustzone
 tscr
 tskidle
 tskyield
+tt
 ttc
 ttl
 twoechoclient
@@ -2860,6 +2946,7 @@ ultimer
 ultotalframelength
 ultrascale
 ultx
+ulvaluelen
 ulvaluetosend
 ulwantedbaud
 umount
@@ -2867,6 +2954,7 @@ un
 unblockes
 unconfigure
 unconfigured
+undefine
 unferenced
 unicast
 uninitialised
@@ -2885,6 +2973,7 @@ unusued
 updatejobexecution
 uploadhttpexample
 upto
+urandom
 urc
 urcevent
 uri
@@ -2947,6 +3036,8 @@ uxbitsgetval
 uxbitssetval
 uxbufferlength
 uxbytesleft
+uxbytesreceived
+uxbytessent
 uxcreatortaskstackbuffer
 uxerrorhasoccurred
 uxeventgroupgetnumber
@@ -2966,6 +3057,8 @@ uxmaxcount
 uxmessageswaiting
 uxnewpriority
 uxnumbertocreate
+uxpacketsreceived
+uxpacketssent
 uxparameternumber
 uxpriority
 uxqueue
@@ -2984,6 +3077,7 @@ uxsecs
 uxsemaphoregetcount
 uxstackbuffer
 uxstate
+uxstreambufferadd
 uxstringlength
 uxsynchronisationbit
 uxtaskgetnumberoftasks
@@ -2997,6 +3091,7 @@ uxtick
 uxtxstackbuffer
 uxvariabletoincrement
 valdiate
+valgrind
 vanexampleisr
 vapplicationfpusafeirqhandler
 vapplicationftpreceivedhook
@@ -3018,6 +3113,8 @@ vblink
 vbus
 vbuttonhandlertask
 vbuttonisrhandler
+vcellularconnecttask
+vcellulardemotask
 vclearemactxbuffer
 vconfiguretimerforruntimestats
 vcore
@@ -3064,6 +3161,8 @@ vlistinsertend
 vlistintert
 vlistintertend
 vlogginginit
+vloggingprintf
+vlt
 vlwipappsreleasetxbuffer
 vmain
 vmaindeleteme
@@ -3107,6 +3206,7 @@ vqueueunregisterqueue
 vqueuewaitformessagerestricted
 vregistercheck
 vregtest
+vrxfaultinjection
 vsecondregistertesttask
 vsemaphorecreatebinary
 vsemaphoredelete
@@ -3116,6 +3216,7 @@ vsetandcheckregisters
 vsetuphighfrequencytimer
 vsetuptimertest
 vsimplesubscribepublishtask
+vsnprintf
 vstart
 vstartdefenderdemo
 vstartfleetprovisioningdemo
@@ -3169,6 +3270,7 @@ wasn
 wdt
 wdtm
 webmax
+weierstrass
 wether
 wi
 wifi
@@ -3409,6 +3511,7 @@ xpendingreadylist
 xperiod
 xpingreqtimer
 xpingresptimer
+xpkhandle
 xplained
 xport
 xportalt
@@ -3490,6 +3593,7 @@ xreadblocktime
 xreceived
 xreceivedbytes
 xreceivelength
+xrecvbuffer
 xrecvloop
 xregions
 xregionssettings
@@ -3546,7 +3650,10 @@ xserialportinitminimal
 xserialsendstring
 xserver
 xsession
+xsessionhandle
 xsetupcomplete
+xsigbuffersize
+xsiglen
 xsignature
 xsignaturelength
 xsignercertificatelength
@@ -3643,12 +3750,14 @@ xtransfercompletedelay
 xtransfersocket
 xtransmitted
 xtrueobject
+xts
 xttcps
 xtxbuffermutex
 xtxdescriptors
 xtxhasended
 xtxmessages
 xtxtcbbuffer
+xtype
 xudpportsarraylength
 xupdatedmessagebuffer
 xurllen