summaryrefslogtreecommitdiffstats
path: root/llvm/test/Analysis/CostModel/X86
Commit message (Collapse)AuthorAgeFilesLines
...
* [CostModel][X86] Added tests for current integer trunc costsSimon Pilgrim2016-10-231-0/+141
| | | | llvm-svn: 284938
* [CostModel][X86] Fixed AVX1/AVX512 sdiv/udiv uniformconst costs for 256/512 ↵Simon Pilgrim2016-10-201-36/+32
| | | | | | | | bit integer vectors We weren't checking for uniform const costs before the general cost, resulting in very high estimates. llvm-svn: 284755
* [CostModel][X86] Added tests for sdiv/udiv costs for uniform const and ↵Simon Pilgrim2016-10-201-0/+264
| | | | | | | | uniform const power-of-2 Shows poor costings in AVX1/AVX512BW for certain vector types llvm-svn: 284748
* [CostModel][X86] Fixed AVX1/AVX512 sdiv/udiv general costs for 256/512 bit ↵Simon Pilgrim2016-10-201-76/+24
| | | | | | | | | | integer vectors We weren't accounting for legal types on every subtarget, meaning that many of the costs were using defaults. We still don't correctly cost (or test) the 512-bit sdiv/udiv by uniform const cases, nor the power-of-2 cases. llvm-svn: 284744
* [CostModel][X86] Added tests for sdiv/udiv costs for scalar and 128/256/512 ↵Simon Pilgrim2016-10-201-29/+165
| | | | | | | | bit integer vectors Shows current bug in AVX1/AVX512BW costs for 256 bit vector types llvm-svn: 284723
* [X86][SSE] Add lowering to cvttpd2dq/cvttps2dq for sitofp v2f64/2f32 to 2i32Simon Pilgrim2016-10-181-9/+9
| | | | | | | | | | | | As discussed on PR28461 we currently miss the chance to lower "fptosi <2 x double> %arg to <2 x i32>" to cvttpd2dq due to its use of illegal types. This patch adds support for fptosi to 2i32 from both 2f64 and 2f32. It also recognises that cvttpd2dq zeroes the upper 64-bits of the xmm result (similar to D23797) - we still don't do this for the cvttpd2dq/cvttps2dq intrinsics - this can be done in a future patch. Differential Revision: https://reviews.llvm.org/D23808 llvm-svn: 284459
* [x86, SSE/AVX] allow 128/256-bit lowering for copysign vector intrinsics ↵Sanjay Patel2016-10-031-28/+28
| | | | | | | | | | | | | | | | (PR30433) This should fix: https://llvm.org/bugs/show_bug.cgi?id=30433 There are a couple of open questions about the codegen: 1. Should we let scalar ops be scalars and avoid vector constant loads/splats? 2. Should we have a pass to combine constants such as the inverted pair that we have here? Differential Revision: https://reviews.llvm.org/D25165 llvm-svn: 283119
* [CostModel][X86] Added tests for current fptosi/fptoui costsSimon Pilgrim2016-10-012-0/+501
| | | | llvm-svn: 283047
* [CostModel][X86] Added fcopysign costsSimon Pilgrim2016-10-011-0/+65
| | | | llvm-svn: 283044
* [CostModel][X86] Added fabs costsSimon Pilgrim2016-10-011-0/+65
| | | | llvm-svn: 283042
* [CostModel][X86] Added scalar float op costsSimon Pilgrim2016-09-181-252/+340
| | | | llvm-svn: 281864
* [CostModel][X86] Removed shift testsSimon Pilgrim2016-08-211-80/+0
| | | | | | There are more thorough tests found in vshift-*-cost.ll llvm-svn: 279406
* [CostModel][X86] Added costs for vXi16 and vXi8 vectors for ↵Simon Pilgrim2016-08-211-114/+372
| | | | | | add/sub/mul/and/or/xor tests llvm-svn: 279405
* [CostModel][X86] Replaced SSSE3 with SSE2 costs to create a better baselineSimon Pilgrim2016-08-211-43/+43
| | | | llvm-svn: 279404
* [CostModel][X86] Added fsqrt and fma costsSimon Pilgrim2016-08-211-2/+104
| | | | llvm-svn: 279403
* [CostModel][X86] Split off float arithmetic cost testsSimon Pilgrim2016-08-212-215/+224
| | | | llvm-svn: 279402
* [CostModel][X86] Added sub, or, and, fadd and fsub costs and missing 512-bit ↵Simon Pilgrim2016-08-191-0/+227
| | | | | | mul costs llvm-svn: 279301
* [CostModel][X86] Added some AVX512 and 512-bit vector cost testsSimon Pilgrim2016-08-191-0/+129
| | | | llvm-svn: 279291
* [CostModel][X86] Add fdiv + frem cost testsSimon Pilgrim2016-08-191-2/+32
| | | | llvm-svn: 279283
* [LV, X86] Be more optimistic about vectorizing shifts.Michael Kuperstein2016-08-041-0/+39
| | | | | | | | | | | | | | | Shifts with a uniform but non-constant count were considered very expensive to vectorize, because the splat of the uniform count and the shift would tend to appear in different blocks. That made the splat invisible to ISel, and we'd scalarize the shift at codegen time. Since r201655, CodeGenPrepare sinks those splats to be next to their use, and we are able to select the appropriate vector shifts. This updates the cost model to to take this into account by making shifts by a uniform cheap again. Differential Revision: https://reviews.llvm.org/D23049 llvm-svn: 277782
* [X86] Dropped XOP ctbits checks - they match the AVX checksSimon Pilgrim2016-08-041-62/+2
| | | | llvm-svn: 277718
* [X86][SSE] Add initial costs for vector CTTZ/CTLZSimon Pilgrim2016-08-042-99/+163
| | | | llvm-svn: 277716
* [X86][SSE] Add cost model values for CTPOP of vectorsSimon Pilgrim2016-07-201-24/+40
| | | | | | | | This patch adds costs for the vectorized implementations of CTPOP, the default values were seriously underestimating the cost of these and was encouraging vectorization on targets where serialized use of POPCNT would be much better. Differential Revision: https://reviews.llvm.org/D22456 llvm-svn: 276104
* [X86] Add CTPOP/CTLZ/CTTZ scalar cost testsSimon Pilgrim2016-07-171-6/+171
| | | | llvm-svn: 275725
* [X86] Make some cast costs more preciseMichael Kuperstein2016-07-113-35/+35
| | | | | | | | | Make some AVX and AVX512 cast costs more precise. Based on part of a patch by Elena Demikhovsky (D15604). Differential Revision: http://reviews.llvm.org/D22064 llvm-svn: 275106
* [x86] fix cost of SINT_TO_FP for i32 --> float (PR21356, PR28434)Sanjay Patel2016-07-061-6/+6
| | | | | | | | | | | | | This is "cvtdq2ps" which does not appear to be particularly slow on any CPU according to Agner's tables. Choosing "5" as a cost here as suggested in: https://llvm.org/bugs/show_bug.cgi?id=21356 ...but it seems very conservative given that the instruction is fully pipelined, and I think these costs are supposed to model throughput. Note that related costs are also most likely too high, but this fixes PR21356 and partly fixes PR28434. llvm-svn: 274658
* [TTI] The cost model should not assume vector casts get completely scalarizedMichael Kuperstein2016-07-062-121/+121
| | | | | | | | | | | | | | | | The cost model should not assume vector casts get completely scalarized, since on targets that have vector support, the common case is a partial split up to the legal vector size. So, when a vector cast gets split, the resulting casts end up legal and cheap. Instead of pessimistically assuming scalarization, base TTI can use the costs the concrete TTI provides for the split vector, plus a fudge factor to account for the cost of the split itself. This fudge factor is currently 1 by default, except on AMDGPU where inserts and extracts are considered free. Differential Revision: http://reviews.llvm.org/D21251 llvm-svn: 274642
* Support arbitrary addrspace pointers in masked load/store intrinsicsArtur Pilipenko2016-06-281-29/+27
| | | | | | | | | | | | | | This is a resubmittion of 263158 change after fixing the existing problem with intrinsics mangling (see LTO and intrinsics mangling llvm-dev thread for details). This patch fixes the problem which occurs when loop-vectorize tries to use @llvm.masked.load/store intrinsic for a non-default addrspace pointer. It fails with "Calling a function with a bad signature!" assertion in CallInst constructor because it tries to pass a non-default addrspace pointer to the pointer argument which has default addrspace. The fix is to add pointer type as another overloaded type to @llvm.masked.load/store intrinsics. Reviewed By: reames Differential Revision: http://reviews.llvm.org/D17270 llvm-svn: 274043
* Revert -r273892 "Support arbitrary addrspace pointers in masked load/store ↵Artur Pilipenko2016-06-271-27/+29
| | | | | | intrinsics" since some of the clang tests don't expect to see the updated signatures. llvm-svn: 273895
* Support arbitrary addrspace pointers in masked load/store intrinsicsArtur Pilipenko2016-06-271-29/+27
| | | | | | | | | | | | | | This is a resubmittion of 263158 change after fixing the existing problem with intrinsics mangling (see LTO and intrinsics mangling llvm-dev thread for details). This patch fixes the problem which occurs when loop-vectorize tries to use @llvm.masked.load/store intrinsic for a non-default addrspace pointer. It fails with "Calling a function with a bad signature!" assertion in CallInst constructor because it tries to pass a non-default addrspace pointer to the pointer argument which has default addrspace. The fix is to add pointer type as another overloaded type to @llvm.masked.load/store intrinsics. Reviewed By: reames Differential Revision: http://reviews.llvm.org/D17270 llvm-svn: 273892
* [X86] Make arithmetic operations cost model test saner. NFC.Michael Kuperstein2016-06-211-83/+128
| | | | llvm-svn: 273316
* [X86][SSE] Add cost model for BSWAP of vectorsSimon Pilgrim2016-06-202-38/+38
| | | | | | | | The BSWAP of vector types is quite efficiently implemented using vector shuffles on SSE/AVX targets, we should reflect the typical cost of this to encourage vectorization. Differential Revision: http://reviews.llvm.org/D21521 llvm-svn: 273217
* [CostModel][X86][SSE] Updated costs for vector BITREVERSE ops on SSSE3+ targetsSimon Pilgrim2016-06-111-24/+24
| | | | | | To account for the fast PSHUFB implementation now available llvm-svn: 272484
* [X86] Add costs for SSE zext/sext to v4i64 to TTIMichael Kuperstein2016-06-101-0/+79
| | | | | | | | | The costs are somewhat hand-wavy, but should be much closer to the truth than what we get from BasicTTI. Differential Revision: http://reviews.llvm.org/D21156 llvm-svn: 272406
* [CostModel][X86][XOP] Added XOP costmodel for BITREVERSE Simon Pilgrim2016-05-241-12/+12
| | | | | | Now that we have a nice fast VPPERM solution. Added framework for future intrinsic costs as well. llvm-svn: 270537
* [CostModel][X86] Tidied up checksSimon Pilgrim2016-05-171-125/+45
| | | | llvm-svn: 269770
* [CostModel][X86] Added scalar bitreverse testsSimon Pilgrim2016-05-151-0/+51
| | | | llvm-svn: 269594
* [X86][SSE] Improve cost model for i64 vector comparisons on pre-SSE42 targetsSimon Pilgrim2016-05-091-8/+8
| | | | | | | | | | | | As discussed on PR24888, until SSE42 we don't have access to PCMPGTQ for v2i64 comparisons, but the cost models don't reflect this, resulting in over-optimistic vectorizaton. This patch adds SSE2 'base level' costs that match what a typical target is capable of and only reduces the v2i64 costs at SSE42. Technically SSE41 provides a PCMPEQQ v2i64 equality test, but as getCmpSelInstrCost doesn't give us a way to discriminate between comparison test types we can't easily make use of this, otherwise we could split the cost of integer equality and greater-than tests to give better costings of each. Differential Revision: http://reviews.llvm.org/D20057 llvm-svn: 268972
* [CostModel][X86] Extended comparison instruction cost model tests to include ↵Simon Pilgrim2016-05-081-33/+113
| | | | | | SSE2/SSE3/SSSE3/SSE41/SSE42 targets llvm-svn: 268877
* [CostModel][X86] Split BSWAP/BITREVERSE cost tests from CTPOP/CTLZ/CTTZ 'bit ↵Simon Pilgrim2016-05-073-176/+188
| | | | | | count' cost tests llvm-svn: 268859
* [CostModel][X86] Tweak 'SSE2-only' test CPU as it was only disabling SSE41 ↵Simon Pilgrim2016-05-061-1/+1
| | | | | | not SSE3/SSSE3 etc. llvm-svn: 268763
* [CostModel][X86] Added ctlz/cttz undef-zero costmodel testsSimon Pilgrim2016-05-061-32/+209
| | | | llvm-svn: 268761
* [CostModel][X86] Added costmodel tests for vector ↵Simon Pilgrim2016-05-061-0/+481
| | | | | | ctpop/ctlz/cttz/bitreverse/bswap llvm-svn: 268738
* [X86]: Changing cost for “TRUNCATE v16i32 to v16i8” in SSE4.1 mode.Ashutosh Nema2016-04-221-1/+1
| | | | | | | | | | | | | | Summary: rL256194 transforms truncations between vectors of integers into PACKUS/PACKSS operations during DAG combine. This generates better code for truncate, so cost of truncate needs to be changed but looks like it got changed only in SSE2 table Whereas this change is also applicable for SSE4.1, so the cost of truncate needs to be changed for that as well. Cost of “TRUNCATE v16i32 to v16i8” & “TRUNCATE v16i16 to v16i8” should be same in SSE4.1 & SSE2 table. Removing their cost from SSE4.1, so it will fall back to SSE2. Reviewers: Simon Pilgrim llvm-svn: 267123
* Revert "Support arbitrary addrspace pointers in masked load/store intrinsics"Adam Nemet2016-04-141-27/+29
| | | | | | | | This reverts commit r266086. It breaks the LTO build of gcc in SPEC2000. llvm-svn: 266282
* Support arbitrary addrspace pointers in masked load/store intrinsicsArtur Pilipenko2016-04-121-29/+27
| | | | | | | | | | | | | | This is a resubmittion of 263158 change. This patch fixes the problem which occurs when loop-vectorize tries to use @llvm.masked.load/store intrinsic for a non-default addrspace pointer. It fails with "Calling a function with a bad signature!" assertion in CallInst constructor because it tries to pass a non-default addrspace pointer to the pointer argument which has default addrspace. The fix is to add pointer type as another overloaded type to @llvm.masked.load/store intrinsics. Reviewed By: reames Differential Revision: http://reviews.llvm.org/D17270 llvm-svn: 266086
* [TTI] Let the cost model estimate ctpop costs based on legalityBenjamin Kramer2016-03-311-8/+8
| | | | | | | | | PPC has a vector popcount, this lets the vectorizer use the correct cost for it. Tweak X86 test to use an intrinsic that's actually scalarized (we have a somewhat efficient lowering for vector popcount using SSE, the cost model finds that now). llvm-svn: 265005
* Revert "Support arbitrary addrspace pointers in masked load/store intrinsics"Matthias Braun2016-03-221-27/+29
| | | | | | | | | | | This commit broke LTO builds. Reverting it to unbreak the bots while the issue is investigated. See also: http://lists.llvm.org/pipermail/llvm-commits/Week-of-Mon-20160321/341002.html This reverts r263158 llvm-svn: 264088
* Support arbitrary addrspace pointers in masked load/store intrinsicsArtur Pilipenko2016-03-101-29/+27
| | | | | | | | | | | | This patch fixes the problem which occurs when loop-vectorize tries to use @llvm.masked.load/store intrinsic for a non-default addrspace pointer. It fails with "Calling a function with a bad signature!" assertion in CallInst constructor because it tries to pass a non-default addrspace pointer to the pointer argument which has default addrspace. The fix is to add pointer type as another overloaded type to @llvm.masked.load/store intrinsics. Reviewed By: reames Differential Revision: http://reviews.llvm.org/D17270 llvm-svn: 263158
* Implemented cost model for masked gather and scatter operationsElena Demikhovsky2015-12-281-1/+214
| | | | | | | | | The cost is calculated for all X86 targets. When gather/scatter instruction is not supported we calculate the cost of scalar sequence. Differential revision: http://reviews.llvm.org/D15677 llvm-svn: 256519
OpenPOWER on IntegriCloud