HPCortex Documentation

Contents:

• Dependencies
• Installation
• Getting started
  • Building a simple model
  • Training the model
  • Inference

API:

• Accelerator
  • strong_inline
  • DO_PRAGMA_
  • DO_PRAGMA
  • thread_num
  • thread_max
  • set_threads
  • in_thread_parallel_region
  • thread_for
  • thread_for3d
  • thread_for2d
  • accelerator
  • accelerator_inline
  • accelerator_barrier
  • accelerator_for3dNB
  • accelerator_for3d
  • accelerator_for2dNB
  • accelerator_for2d
  • accelerator_forNB
  • accelerator_for
  • accelerator_for3d_shm
  • accelerator_for2dNB_shm
  • accelerator_for2d_shm
  • accelerator_forNB_shm
  • accelerator_for_shm
  • autoView
  • doHost
  • doHost2
  • doHost3
  • acceleratorInit()
  • acceleratorReport()
  • acceleratorCopyToDevice()
  • acceleratorCopyFromDevice()
  • acceleratorCopyDeviceToDevice()
  • acceleratorCopyDeviceToDeviceAsynch()
  • acceleratorCopySynchronize()
  • acceleratorMemSet()
  • acceleratorAllocHost()
  • acceleratorAllocShared()
  • acceleratorAllocDevice()
  • acceleratorFreeHost()
  • acceleratorFreeShared()
  • acceleratorFreeDevice()
  • profileStart()
  • profileStop()
  • labelRegionBegin()
  • labelRegionEnd()
  • atomicAdd()
  • viewDeallocator
• ActivationFuncs
  • ReLU
  • noActivation
  • GeLU
• Comms
  • communicators()
  • initializeComms()
  • UniqueID()
  • getMPIdataType()
  • commsReduce()
  • commsReduce()
  • commsBroadcast()
  • commsBroadcast()
  • commsBroadcast()
  • Communicators
• Components
• DDP
  • ddpAverage()
  • ddpAverage()
• DynamicModel
  • enwrap()
  • LayerWrapperInternalBase
  • LayerWrapperInternal
  • LayerWrapper
• Embeddings
  • embedPositionsSinusoidal()
  • embedPositionsSinusoidal()
• HPCortex
• Init
  • initialize()
• InstanceStorage
  • DDST
  • ISSTORAGE
  • StorageTag
  • LeafStore
  • LeafRef
  • deduceStorage
  • deduceStorage< T & >
  • deduceStorage< T && >
• Layers
• Linalg
  • thinMulMatMatTranspose_p()
  • thinMulMatMatTranspose()
  • mulMatTransposeThinMat()
  • computeThinMatOuterProd()
  • axpyMatThinMat()
  • batch3tensorContract()
  • matrixBatchTensorAxpy()
  • batchTensorContractToMatrix_p()
  • matrixBatchTensorContractRight()
  • matrixBatchTensorContractLeft()
• LossFunctions
  • CWRP
  • mse_cost()
  • cost_func_wrap()
  • cost_func_wrap()
  • CostFuncWrapper
  • MSEcostFunc
  • MSEcostFunc< Tensor< FloatType, Dim > >
• ManagedArray
  • ManagedArray
• MemoryManager
  • ViewMode
  • memPoolManagerReport()
  • MemoryManager
• Optimizers
  • train()
  • batchData()
  • train()
  • noScheduler
  • GradientDescentOptimizer
  • AdamParams
  • AdamOptimizer
  • DecayScheduler
  • XYpair
  • XYpairDataLoader
• Padding
  • NoPadding
  • SamePaddingZero1D
• Performance
  • FLOPScounter
• Pipelining
  • pipeline_mse_cost()
  • pipeline_block()
  • BatchPipelineCostFuncWrapper
  • PipelineCostFuncWrapper
  • LockControlWrapper
  • LockControlWrapperTensor
  • PipelineCommunicator
  • PipelineBlock
• Random
  • GlobalRNGtype
  • globalRNG()
  • reseedGlobalRNG()
  • random()
  • uniformRandom()
  • uniformRandom()
  • glorotUniformRandom()
  • glorotUniformRandom()
  • drawWeightedRandomIndex()
  • drawWeightedRandomIndex()
  • default_seed
• RingBuffer
  • RingBuffer
• Serialization
  • Endianness
  • toString()
  • endianness()
  • BitReverseTable256()
  • bitReverse()
  • BinaryWriter
  • BinaryReader
• Tensors
  • _1D_TENSOR_ONLY
  • _2D_TENSOR_ONLY
  • _3D_TENSOR_ONLY
  • _4D_TENSOR_ONLY
  • Vector
  • Matrix
  • pokeColumn()
  • pokeRow()
  • peekColumn()
  • peekColumns()
  • pokeColumns()
  • operator<<()
  • operator<<()
  • operator*()
  • operator+=()
  • operator+()
  • operator-=()
  • operator-()
  • operator*=()
  • operator*()
  • operator*()
  • flatten()
  • flatten()
  • unflatten()
  • unflatten()
  • flatten2()
  • unflatten2()
  • flattenNsameDim()
  • unflattenNsameDim()
  • batchTensorConcatenate()
  • batchTensorSplit()
  • norm2()
  • Tensor
• Testing
  • near()
  • near()
  • near()
  • abs_near()
  • abs_near()
  • abs_near()
  • equal()
  • benchmark()
  • testCost()
  • testDeriv()
  • testComponentDeriv()
  • softMaxVector()
• Timing
  • now()
  • usSinceEpoch()
  • usCountSince()
  • since()
• Batch3tensorPairContractComponent
  • Batch3tensorPairContractComponent
• BatchedMatrixRowSoftMaxComponent
  • BatchedMatrixRowSoftMaxComponent
• BatchTensorConcatenateComponent
  • BatchTensorConcatenateComponent
• BatchTensorDimensionSliceComponent
  • BatchTensorDimensionSliceComponent
• BatchTensorDNNcomponent
  • BatchTensorDNNcomponent
• MatrixTensorContractComponent
  • MatrixTensorContractComponent
• MultiHeadAttentionComponent
  • MultiHeadAttentionComponent
• NormComponent
  • NormComponent
• ScaleComponent
  • ScaleComponent
• ScaledDotProductAttentionComponent
  • ScaledDotProductAttentionComponent
• ScaledDotProductAttentionHeadComponent
  • ScaledDotProductAttentionHeadComponent
• SoftMaxComponent
  • SoftMaxComponent
• BatchTensorDNNlayer
  • LAYER_TYPE
  • batch_tensor_dnn_layer()
  • batch_tensor_dnn_layer()
  • batch_tensor_dnn_layer()
  • batch_tensor_unbiased_dnn_layer()
  • dnn_layer()
  • dnn_layer()
  • dnn_layer()
  • dnn_layer()
  • BatchTensorDNNlayer
• ConvolutionLayer1D
  • conv1d_layer()
  • conv1d_layer()
  • ConvolutionLayer1D
• EmbedPositionsSinusoidalLayer
  • embed_positions_sinusoidal_layer()
  • EmbedPositionsSinusoidalLayer
• FlattenLayer
  • flatten_layer()
  • FlattenLayer
• InputLayer
  • input_layer()
  • InputLayer
• LayerCommon
  • ISLEAF
  • FLOATTYPE
  • INPUTTYPE
  • LAYEROUTPUTTYPE
  • LAYERTYPEOUTPUTTYPE
  • LeafTag
• MatrixTensorContractLayer
  • matrix_tensor_contract_layer()
  • MatrixTensorContractLayer
• MultiHeadCrossAttentionLayer
  • TEMPL
  • multihead_cross_attention_layer()
  • multihead_cross_attention_layer()
  • multihead_cross_attention_layer()
  • multihead_cross_attention_layer()
  • multihead_cross_attention_layer()
  • multihead_cross_attention_layer()
  • MultiHeadCrossAttentionLayer
• MultiHeadSelfAttentionLayer
  • multihead_self_attention_layer()
  • multihead_self_attention_layer()
  • multihead_self_attention_layer()
  • multihead_self_attention_layer()
  • multihead_self_attention_layer()
  • multihead_self_attention_layer()
  • MultiHeadSelfAttentionLayer
• NormLayer
  • norm_layer()
  • norm_layer()
  • NormLayer
• PairJoinLayer
  • pair_join_layer()
  • PairJoinLayer
• PairSplitLayer
  • pair_split_layer()
  • PairSplitLayerLeader
  • PairSplitLayer1
  • PairSplitLayer2
• ReplicateLayer
  • replicate_layer()
  • ReplicateLayerLeader
  • ReplicateLayer
• ScaledDotProductSelfAttentionLayer
  • scaled_dotproduct_self_attention_layer()
  • scaled_dotproduct_self_attention_layer()
  • ScaledDotProductSelfAttentionLayer
• SkipConnection
  • skip_connection()
  • SkipConnection
• SoftMaxLayer
  • softmax_layer()
  • SoftMaxLayer
• SumJoinLayer
  • sum_join_layer()
  • SumJoinLayer
• TransformerEncoderDecoderBlock
  • transformer_decoder_block()
  • transformer_encoder_block()
  • transformer_cross_decoder_block()
• UnflattenLayer
  • unflatten_layer()
  • UnflattenLayer