Morgan Kaufmann Publishers is an imprint of Elsevier. 30 Corporate Drive,Suite 400.Burlington,MA 01803,USA This book is printed on acid-free paper. 2010 David B.Kirk/NVIDIA Corporation and Wen-mei Hwu.Published by Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means.electronic or mechanical,including photocopying,recording.or any information storage and retrieval system,without permission in writing from the publisher.Details on how to seek permission,further information about the Publisher's permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency.can be found at our website:www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). NVIDIA,the NVIDIA logo.CUDA,GeForce,Quadro,and Tesla are trademarks or registered trademarks of NVIDIA Corporation in the U.S.and other countries. OpenCL is a trademark of Apple Inc. Notices Knowledge and best practice in this field are constantly changing.As new research and experience broaden our understanding.changes in research methods,professional practices.or medical treatment may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information,methods,compounds,or experiments described herein.In using such information or methods they should be mindful of their own safety and the safety of others,including parties for whom they have a professional responsibility. To the fullest extent of the law,neither the Publisher nor the authors.contributors.or editors.assume any liability for any injury and/or damage to persons or property as a matter of products liability. negligence or otherwise,or from any use or operation of any methods.products,instructions,or ideas contained in the material herein. Library of Congress Cataloging-in-Publication Data Application Submitted British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. ISBN:978-0-12-381472-2 For information on all Morgan Kaufmann publications. visit our Web site at www.mkp.com or www.elsevierdirect.com Printed in United States of America 101112131454321 Working together to grow libraries in developing countries www.clscvicr.com www.bookaid.org www.sabre.org ELSEVIER BOOK AID nternational Sabre FoundationMorgan Kaufmann Publishers is an imprint of Elsevier. 30 Corporate Drive, Suite 400, Burlington, MA 01803, USA This book is printed on acid-free paper. # 2010 David B. Kirk/NVIDIA Corporation and Wen-mei Hwu. Published by Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). NVIDIA, the NVIDIA logo, CUDA, GeForce, Quadro, and Tesla are trademarks or registered trademarks of NVIDIA Corporation in the U.S. and other countries. OpenCL is a trademark of Apple Inc. Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods, professional practices, or medical treatment may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods, compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility. To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein. Library of Congress Cataloging-in-Publication Data Application Submitted British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. ISBN: 978-0-12-381472-2 For information on all Morgan Kaufmann publications, visit our Web site at www.mkp.com or www.elsevierdirect.com Printed in United States of America 10 11 12 13 14 5 4 3 2 1