期刊文献+
共找到4篇文章
< 1 >
每页显示 20 50 100
SlimGC:面向分布式深度学习的梯度压缩优化策略
1
作者 白哲 于恩达 董德尊 《计算机学报》 北大核心 2025年第5期1168-1187,共20页
梯度压缩是缓解分布式深度学习中通信瓶颈的关键技术。然而,通过梯度压缩实现显著的性能改进仍然具有挑战性。在实际应用中,梯度压缩面临着以下几个挑战:(1)不能有效优化小规模张量通信的启动开销;(2)压缩操作可能会与张量计算竞争GPU资... 梯度压缩是缓解分布式深度学习中通信瓶颈的关键技术。然而,通过梯度压缩实现显著的性能改进仍然具有挑战性。在实际应用中,梯度压缩面临着以下几个挑战:(1)不能有效优化小规模张量通信的启动开销;(2)压缩操作可能会与张量计算竞争GPU资源,从而延迟梯度传输的启动时机;(3)它可能引发需要谨慎处理的模型精度问题。为了最大限度地发挥梯度压缩的优势并应对这些挑战,本文设计了SlimGC策略来用于通用梯度压缩增强。此外,为了避免对GPU算力和内存资源的争用,SlimGC将压缩操作卸载给CPU,并采用模型备份技术,该技术解除了工作节点间对模型参数的读取依赖,从而隐藏CPU压缩成本和部分通信开销。本文的实验是在一个拥有16个V100 GPU的集群上进行的。实验评估表明,对于典型的分布式深度学习训练任务,SlimGC将1bit和2bit压缩算法的训练吞吐量分别最高提高了74.3%和75.9%。此外,它实现了1.1%~2.3%的收敛精度提高,并减少了10.3%的GPU内存消耗。 展开更多
关键词 分布式深度学习 梯度压缩 分布式通信优化 压缩卸载 内存消耗
在线阅读 下载PDF
带有卸载压缩激励的云增强FiWi网络节能机制 被引量:3
2
作者 彭海英 王泽东 吴大鹏 《电子与信息学报》 EI CSCD 北大核心 2020年第7期1726-1733,共8页
针对云增强型光纤-无线(FiWi)网络能耗以及卸载的通信开销过大问题,该文提出一种自适应卸载压缩节能机制(ESAOC),针对不同类型的业务属性和最大的容忍时延,结合光网络单元的负载变化和无线网状网的流量情况,通过统计的方式获得不同优先... 针对云增强型光纤-无线(FiWi)网络能耗以及卸载的通信开销过大问题,该文提出一种自适应卸载压缩节能机制(ESAOC),针对不同类型的业务属性和最大的容忍时延,结合光网络单元的负载变化和无线网状网的流量情况,通过统计的方式获得不同优先级卸载数据的平均到达率,再结合各个节点的压缩时延,动态调整业务的卸载压缩比,以降低卸载的通信开销;同时,建立排队模型分析卸载业务在MEC服务器的排队时延,协同调度无线侧中继节点,进而对光网络单元和终端设备进行协同休眠调度,最大化休眠时长,提高系统能源效率。结果表明,所提方法在有效降低整个网络能耗的同时能够保证卸载业务的时延性能。 展开更多
关键词 光纤-无线网络 自适应压缩 协同休眠 节能
在线阅读 下载PDF
Static compressive properties and damage constitutive model of rubber cement mortar with dry-and wet-curing conditions 被引量:3
3
作者 YANG Rong-zhou XU Ying +1 位作者 CHEN Pei-yuan GONG Jiu 《Journal of Central South University》 SCIE EI CAS CSCD 2021年第7期2158-2178,共21页
To investigate the static compressive properties and mechanical damage evolution of rubber cement-based materials(RCBMs) with dry-and wet-curing conditions, uniaxial compression and cyclic loading-unloading tests were... To investigate the static compressive properties and mechanical damage evolution of rubber cement-based materials(RCBMs) with dry-and wet-curing conditions, uniaxial compression and cyclic loading-unloading tests were carried out on rubber cement mortar(RCM). The mechanical properties of the uniaxial compression specimens cured at 95%(wet-curing) and 50%(dry-curing) relative humidities and cyclic loading-unloading specimens cured at wet-curing were analyzed. Under uniaxial compression, the peak stress loss ratio is higher for dry-curing than for wet-curing. The peak strain decreases with the increase of rubber content, and the peak strain increases with the decrease of curing humidity. Under cyclic loading-unloading, the variation trends of residual strain differences of the normal cement mortar and RCM at each cyclic level with the number of cycles are basically the same, but the failure modes are different. The analysis of the internal mesostructure by a scanning electron microscope(SEM) shows that initial damage is further enhanced by reducing curing humidity and adding rubber aggregate. The damage constitutive model based on strain equivalence principle and statistical theories was used to describe the uniaxial compression characteristics of RCM, and the law of mechanical damage evolution was predicted. 展开更多
关键词 curing humidity rubber cement mortar uniaxial compression cyclic loading-unloading mesoscopic damage constitutive model
在线阅读 下载PDF
Experimental study on energy storage and dissipation characteristics of granite under two-dimensional compression with constant confining pressure 被引量:19
4
作者 SU You-qiang GONG Feng-qiang +1 位作者 LUO Song LIU Zhi-xiang 《Journal of Central South University》 SCIE EI CAS CSCD 2021年第3期848-865,共18页
To study the energy storage and dissipation characteristics of deep rock under two-dimensional compression with constant confining pressure,the single cyclic loading-unloading two-dimensional compression tests were pe... To study the energy storage and dissipation characteristics of deep rock under two-dimensional compression with constant confining pressure,the single cyclic loading-unloading two-dimensional compression tests were performed on granite specimens with two height-to-width(H/W)ratios under five confining pressures.Three energy density parameters(input energy density,elastic energy density and dissipated energy density)in the axial and lateral directions of granite specimens under different confining pressures were calculated using the area integral method.The experimental results show that,for the specimens with a specific H/W ratio,these three energy density parameters in the axial and lateral directions increase nonlinearly with the confining pressure as quadratic polynomial functions.Under constant confining pressure compression,the linear energy storage law of granite specimens in the axial and lateral directions was founded.Using the linear energy storage law in different directions,the elastic energy density in various directions(axial elastic energy density,lateral elastic energy density and total elastic energy density)of granite under any specific confining pressures can be calculated.When the H/W ratio varies from 1:1 to 2:1,the lateral compression energy storage coefficient increases and the corresponding axial compression energy storage coefficient decreases,while the total compression energy storage coefficient is almost independent of the H/W ratio. 展开更多
关键词 rock mechanics two-dimensional compression linear energy storage law single cyclic loading-unloading height-to-width ratio
在线阅读 下载PDF
上一页 1 下一页 到第
使用帮助 返回顶部